?????????????????????Hadoop??Apache Spark??????????????????????????????????????????????????????????ж?????????????????????治???????????????????????????
??????????????治???
?????????Hadoop??Apache Spark?????????????????????????????????????Hadoop???????????????????????????: ??????????????????????????????????????е????????д洢????ζ????????????????????????????????
????????Hadoop???????????????Щ???????????????????Ч??????δ?е????Spark???????????????????????Щ?????洢?????????д??????????????????з????????洢??
????????????
????Hadoop?????????????????HDFS????????洢????????????????MapReduce???????????????????????????????????Spark?????Hadoop?????MapReduce??????????????
????????Spark?????????????Hadoop??????????檔??????????????????????????????????????????????????????????????м??????????????????????????Hadoop??HDFS??????????????????????????????????Spark???????????????Hadoop??????????????????????????????
???????????????麣?????????????MapReduce????????????:
????????????????е??????顣????1??????????2??????????“Map”??????????????????
?????????????????????????????????????????“Reduce”??
????Spark??????????MapReduce
????Spark????????????????????????MapReduce??????MapReduce????????????д????: ”?????ж?????????????δ?????????д????????????ж?????o???????????????ε??????????д??????????…“ Booz Allen Hamilton??????????Kirk Borne????????
????????Spark?????????????????“??”???????????е??????????“?????ж?????????????б?????????????????д??????????” Born?????Spark????????????MapReduce???10????????е???????????????100????
????????????????????????????????????????????????????????????????????MapReduce??????????????????????
????????????????????????з???????????Щ????????????????????????????????????????????????????????????????????????????Spark???д????
???????????????????????????????????????????????Spark????ó????????·??棺?????г???????????????????簲??????????????????
??????????
????????????????????????????????????Hadoop????δ??????????д???????????????????????е?????????????д????
????Spark?????????洢?????????????е????????????????(RDD: Resilient Distributed Dataset)?С?“??Щ????????????????棬????????????????RDD?????????????????????????”Borne?????