??????Hadoop????????????????
1. ????Java???C????????????
2. ?????????????????Sina????(??)?Weibo??????(??)?????????????????????????????????????????????????????????????????????????????????????“?”?“???”???????????????
3. ???????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????
Hadoop???????HDFS?MapReduce?
HDFS - Hadoop Distributed FileSystem?????????????????????????????Non SQL??????????????HDFS?HBASE????Hbase??????Big Table?DynamoDB?Mango??HDFS?????Hadoop The Definitive Guide?????????????
MapReduce - ?????????????????????Map?Reduce??????????????????????YARN????????????MapReduce??????????YARN????????????????YARN???MapReduce?????????????Partition, combine, shuffle, sort, ??????????????????MapReduce??????
??Hadoop??????
??????????Hadoop??????????????????
????long running cluster?????Yahoo?????????????????????Yahoo??Hadoop??????????????Data Center????????Node?Hadoop Cluster????????????Big Data?????????????????????
???????MapReduce????????Cloud?????AWS?Elastic MapReduce????????????????????s3????data center? sql database????????????????Hadoop Cluster?Hive/Pig/Spark/Presto/Java?????????????Admin?????????
????????Hadoop??????????AWS???????(??EMR??????????????Node???????????)??????????????????????????????????????????????container size?memory??????????Spark??????
?????????hadoop?????????????google?????????????????Hadoop???????????????????????????Hadoop??????????????????Hadoop ??????????????????????????????????????????
?????????hadoop????????????????????????????
???????????“????”?????Hadoop????MapReduce?????????????;????????????Hadoop?
??????????????????????????????????????????????Google?????????????google?????????????????????google????
????(??????)????????????????;??????????????????????????????Copy to China??????????????????????
???????????????????????????????????;????????????????????????????????????????????????????
???????????“????”?????Hadoop????MapReduce?????????????;????????????Hadoop?
??????????????????????????????????????????????Google?????????????google?????????????????????google????
????(??????)????????????????;??????????????????????????????Copy to China??????????????????????
???????????????????????????????????;????????????????????????????????????????????????????
无关风月 无关诗书！