티스토리 뷰

공부 (@Deprecated)

[aws] emr machine usage (mem & cpu)

승가비 2023. 7. 16. 11:01
728x90

r5a.8xlargeConfiguration optionDefault value

mapreduce.map.java.opts -Xmx6349m
mapreduce.reduce.java.opts -Xmx12698m
mapreduce.map.memory.mb 7936
mapreduce.reduce.memory.mb 15872
yarn.app.mapreduce.am.resource.mb 15872
yarn.scheduler.minimum-allocation-mb 32
yarn.scheduler.maximum-allocation-mb 253952
yarn.nodemanager.resource.memory-mb 253952

https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-hadoop-task-config.html#w221aac26c21b7c23d115b9

 

Task configuration - Amazon EMR

Task configuration You can set configuration variables to tune the performance of your MapReduce jobs. This section provides the default values for important settings. Default values vary based on the EC2 instance type of the node used in the cluster. HBas

docs.aws.amazon.com

 

728x90
저작자표시 비영리 (새창열림)

'공부 (@Deprecated)' 카테고리의 다른 글

[airflow] configurations  (0) 2023.07.16
[github] actions not working  (0) 2023.07.16
[airflow] FAILED: Can't locate revision identified by '03afc6b6f902' #16104  (0) 2023.07.15
[tableau] tsm maintenance ziplogs  (0) 2023.07.15
[tableau] license activate  (0) 2023.07.15
댓글