HowTo: AWS CLI Elastic MapReduce
Elastic MapReduce is one of the services that the AWS CLI tool covers. However if you were to look at the help information, aws emr run-job-flow help
, you will see that there are many parameters and there is not much in obvious ways of finding what the values should be.
Looking at the developer guide for Create a Job Flow and the API reference for RunJobFlow will help a bit. However there is one resource which can help immensely if we can get it to reveal its secrets, that resource is the Elastic MapReduce ruby client. See HowTo: Install AWS CLI - Amazon Elastic MapReduce Ruby Client if you need to install it.
There is a verbose option, -v
, that you can pass that will show the URL, query string, and headers that are sent (however the headers will not be necessary for the AWS CLI tool). This series of articles will go through the examples from the developer guide for Create a Job Flow, but with the verbose option on and showing in turn the AWS CLI command.
Parts in this series
- HowTo: AWS CLI Elastic MapReduce
- HowTo: AWS CLI Elastic MapReduce - Hive Script
- HowTo: AWS CLI Elastic MapReduce - Interactive Hive
- HowTo: AWS CLI Elastic MapReduce - Pig Script
- HowTo: AWS CLI Elastic MapReduce - Interactive Pig
- HowTo: AWS CLI Elastic MapReduce - Streaming Job Flow
- HowTo: AWS CLI Elastic MapReduce - Cascading Job Flow
- HowTo: AWS CLI Elastic MapReduce - Custom JAR Job Flow
- HowTo: AWS CLI Elastic MapReduce - HBase