Database Reference
In-Depth Information
Choose the key. Again, don't let CM create the key for you. Ask Amazon, and store
the key in a secure place.
Hold on, we are almost done. Now, let's start 10 more instances that will be used
for cluster construction. There are two reasons why I start them myself rather than
asking CM to start them for me. Firstly, it results in saving money. I will start spot
instances, whereas CM can only start on-demand ones. Secondly, it has better
control. If something does not work, I can see it much better than CM can.
You are familiar by now with most of the steps. Except that this time, I am starting
10 instances at once, saving a lot of money in the process.
.
These 10 instances will be the workhorses of the cluster, so I will give them enough
root space, that is, 100 GB. The CM is smart enough to get the ephemeral storage
(about 5 TB) and make it a part of the HDFS. The result will approximately be a 5-TB
cluster for one dollar per hour. Here are all of these pending requests:
