ï»??xml version="1.0" encoding="utf-8" standalone="yes"?>BlogJava-<b>成都心情</b>http://www.qpkxbc.shop/rosen/zh-cnSat, 24 Aug 2019 01:10:41 GMTSat, 24 Aug 2019 01:10:41 GMT60Hadoop周刊—第 176 æœ?/title><link>http://www.qpkxbc.shop/rosen/archive/2016/07/12/431174.html</link><dc:creator>Rosen</dc:creator><author>Rosen</author><pubDate>Tue, 12 Jul 2016 13:21:00 GMT</pubDate><guid>http://www.qpkxbc.shop/rosen/archive/2016/07/12/431174.html</guid><wfw:comment>http://www.qpkxbc.shop/rosen/comments/431174.html</wfw:comment><comments>http://www.qpkxbc.shop/rosen/archive/2016/07/12/431174.html#Feedback</comments><slash:comments>0</slash:comments><wfw:commentRss>http://www.qpkxbc.shop/rosen/comments/commentRss/431174.html</wfw:commentRss><trackback:ping>http://www.qpkxbc.shop/rosen/services/trackbacks/431174.html</trackback:ping><description><![CDATA[<p align="left" style="line-height: 10%;"><strong> </strong></p> <p align="left" style="line-height: 10%;"><strong><span style="font-size:16.0pt;line-height:10%">Hadoop</span></strong><strong><span style="font-size:16.0pt;line-height:10%;font-family:宋体;">周刊</span></strong><strong> </strong><strong><span style="font-size:16.0pt;line-height: 10%;font-family:宋体;">½W?/span></strong><strong><span style="font-size:16.0pt;line-height:10%"> 176 </span></strong><strong><span style="font-size:16.0pt;line-height: 10%;font-family:宋体;">æœ?/span></strong><strong></strong></p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">启明星辰òq›_°å’Œå¤§æ•°æ®æ€ÖM½“¾l„ç¼–è¯?/span></p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"><span style="font-size:14.0pt;line-height:10%">2016</span><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">òq?/span><span style="font-size:14.0pt;line-height:10%">6</span><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">æœ?/span><span style="font-size:14.0pt;line-height:10%">29</span><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">æ—?/span></p> <p> </p> <p><span style="font-family:Helvetica;">Hadoop</span><span style="font-family:宋体;">å³îC¼šæœ¬å‘¨åœ¨åœ£ä½•å¡žå¬å¼€åQŒæ‰€ä»¥å¾ˆæœŸå¾…在下期周刊看到新™å¹ç›®çš„发布和¾_‘Ö½©æ¼”讲åQˆè¯·å‘我们提供ä“Q何相关的òqȝ¯ç‰‡ï¼‰ã€‚至于本期周刊,有大量关äº?/span><span style="font-family:Helvetica;">Kafka Streams</span><span style="font-family:宋体;">、从</span><span style="font-family:Helvetica;">Amazon Kinesis</span><span style="font-family:宋体;">å?/span><span style="font-family:Helvetica;">Google BigQuery</span><span style="font-family:宋体;">传递流式数据ã€?/span><span style="font-family:Helvetica;">Google</span><span style="font-family:宋体;">数据集搜索系¾lŸçš„文章ã€?/span></p> <p> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">技术新é—?/span></strong><strong></strong></p> <p><span style="font-family:Helvetica;">Shine</span><span style="font-family:宋体;">介绍了他们如何ä‹Éç”?/span><span style="font-family:Helvetica;">Amazon Lambda</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">Amazon Kinesis</span><span style="font-family:宋体;">åQŒä»¥åŠäؓ</span><span style="font-family: Helvetica;">Apache web</span><span style="font-family: 宋体;">服务器提供的</span><span style="font-family: Helvetica;">Kinesis</span><span style="font-family: 宋体;">代理åQˆç”¨äºŽé‡‡æ—¥å¿—åQ?/span><span style="font-family:宋体;">åQŒä»¥åŠä»Ž</span><span style="font-family:Helvetica;">EC2</span><span style="font-family:宋体;">¿UÕdŠ¨æ•°æ®åˆ?/span><span style="font-family:Helvetica;">Google BigQuery</span><span style="font-family: 宋体;">的内宏V€‚本文提供了</span><span style="font-family:Helvetica;">Lambda</span><span style="font-family:宋体;">函数åQ?/span><span style="font-family:Helvetica;">javascript</span><span style="font-family:宋体;">¾~–写åQ‰ä»£ç ç‰‡ŒDµï¼Œè§„模和开销斚w¢çš„信息,描述了如何通过</span><span style="font-family:Helvetica;">gzip</span><span style="font-family:宋体;">压羃数据从而优化传输开销ã€?/span></p> <p align="left"><a href="https://blog.shinetech.com/2016/06/21/kinesis-lambda-bigquery/"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">https://blog.shinetech.com/2016/06/21/kinesis-lambda-bigquery/</span></a></p> <p> </p> <p><span style="font-family:Helvetica;">Cloudera</span><span style="font-family:宋体;">博客撰文介绍了如何通过</span><span style="font-family: Helvetica;">Apache Spark</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Apache Impala</span><span style="font-family:宋体;">åQˆå­µåŒ–中åQ‰ã€?/span><span style="font-family:Helvetica;">Hue</span><span style="font-family:宋体;">å¯ÒŽ¢¦ä¹‹é˜Ÿæ•°æ®˜q›è¡Œåˆ†æžã€‚本文主要聚焦在分析上,附带了些</span><span style="font-family:Helvetica;">Spark</span><span style="font-family:宋体;">代码以及</span><span style="font-family:Helvetica;">Hue</span><span style="font-family:宋体;">的功能演½Cºã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://blog.cloudera.com/blog/2016/06/how-to-analyze-fantasy-sports-with-apache-spark-and-sql-part-2-data-exploration/</span></p> <p> </p> <p><span style="font-family:Helvetica;">KDnuggets</span><span style="font-family:宋体;">撰文介绍äº?/span><span style="font-family:Helvetica;">13</span><span style="font-family:宋体;">个和</span><span style="font-family:Helvetica;">Apache Spark</span><span style="font-family:宋体;">相关的主è¦?/span><span style="font-family:Helvetica;">API/</span><span style="font-family:宋体;">™å¹ç›®</span><span style="font-family:Helvetica;">/</span><span style="font-family:宋体;">名词。包æ‹?/span><span style="font-family:Helvetica;">RDD</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">DataFrame</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Dataset</span><span style="font-family:宋体;">、结构化‹¹å¼è®¡ç®—ã€?/span><span style="font-family:Helvetica;">GraphX</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Tungsten</span><span style="font-family:宋体;">。每个条目都有一ŒD늫 èŠ‚介¾lï¼Œ­‘›_¤Ÿå¾ˆå¥½çš„了è§?/span><span style="font-family:Helvetica;">Spark</span><span style="font-family:宋体;">主要ç‰ÒŽ€§äº†ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://www.kdnuggets.com/2016/06/spark-key-terms-explained.html</span></p> <p> </p> <p><span style="font-family:宋体;">本文来自</span><span style="font-family:Helvetica;">Confluent</span><span style="font-family:宋体;">博客åQŒä»‹¾läº†é‚£äº›è™½çœ‹èµäh¥½Ž€å•å´åˆä¸½Ž€å•çš„</span><span style="font-family:Helvetica;">Kafka Streams</span><span style="font-family:宋体;">应用。例如用</span><span style="font-family:Helvetica;">Kafka Streams</span><span style="font-family:宋体;">¾~–写¾l“合用户点击‹¹æ•°æ®å’Œç”¨æˆ·ä½ç½®æ•°æ®çš„程序。后者存储在</span><span style="font-family:Helvetica;">KTable</span><span style="font-family:宋体;">中,</span><span style="font-family:Helvetica;">KTable</span><span style="font-family:宋体;">提供了类似带有数据库表主键的抽象åQˆä¸»é”®çš„最新值通过</span><span style="font-family:Helvetica;">API</span><span style="font-family:宋体;">暴露åQ‰ã€‚最后的½E‹åºå€’是½Ž€å?/span><span style="font-family:Helvetica;">——</span><span style="font-family:宋体;">只有几行代码ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://www.confluent.io/blog/distributed-real-time-joins-and-aggregations-on-user-activity-events-using-kafka-streams</span></p> <p> </p> <p><span style="font-family:Helvetica;">Cloudera</span><span style="font-family:宋体;">博客撰文介绍äº?/span><span style="font-family:Helvetica;">meinstadt.de</span><span style="font-family:宋体;">构徏åœ?/span><span style="font-family:Helvetica;">Apache Flume</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Apache Spark Streaming</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Apache Impala</span><span style="font-family:宋体;">åQˆå­µåŒ–中åQ‰ä¸Šçš?/span><span style="font-family:Helvetica;">HTTP</span><span style="font-family:宋体;">è¯äh±‚异常‹‚€‹¹‹ç³»¾lŸã€‚实çŽîC»£ç æ”¾åœ¨äº†</span><span style="font-family: Helvetica;">github</span><span style="font-family:宋体;">上ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://blog.cloudera.com/blog/2016/06/how-to-detect-and-report-web-traffic-anomalies-in-near-real-time/</span></p> <p> </p> <p><span style="font-family:Helvetica;">AWS</span><span style="font-family:宋体;">大数据博客有教程介绍了如何ä‹Éç”?/span><span style="font-family: Helvetica;">Apache Spark</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">Apache Zeppelin</span><span style="font-family:宋体;">ä»?/span><span style="font-family:Helvetica;">Amazon EMR</span><span style="font-family:宋体;">集群处理</span><span style="font-family:Helvetica;">Amazon Kinesis</span><span style="font-family:宋体;">‹¹æ•°æ®ã€‚本文包含了一些通过</span><span style="font-family:Helvetica;">Zeppelin notebook</span><span style="font-family:宋体;">˜qè¡Œ</span><span style="font-family:Helvetica;">SQL</span><span style="font-family:宋体;">产生的数据可视化范例ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://blogs.aws.amazon.com/bigdata/post/Tx3K805CZ8WFBRP/Analyze-Realtime-Data-from-Amazon-Kinesis-Streams-Using-Zeppelin-and-Spark-Strea</span></p> <p> </p> <p><span style="font-family:Helvetica;">Apache Kudu</span><span style="font-family: 宋体;">åQˆå­µåŒ–中åQ‰æŽ¥˜q?/span><span style="font-family:Helvetica;">1.0</span><span style="font-family:宋体;">版发布了åQŒå°†å…¨é¢æ”¯æŒé«˜å¯ç”¨æ€§ã€‚本文介¾läº†˜q™æœ€åŽä¸€å—拼å›?/span><span style="font-family:Helvetica;">“</span><span style="font-family:宋体;">ä¸Õd¤åˆ?/span><span style="font-family:Helvetica;">”</span><span style="font-family:宋体;">是如何实现的。晒了下</span><span style="font-family:Helvetica;">JIRA</span><span style="font-family:宋体;">上各¿Ué—®é¢˜çš„跟进的情况,以及完成与剩余的‹¹‹è¯•ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://kudu.apache.org/2016/06/24/multi-master-1-0-0.html</span></p> <p> </p> <p><span style="font-family:Helvetica;">Google</span><span style="font-family:宋体;">的所有数据åã^台拥有超˜q?/span><span style="font-family: Helvetica;">260</span><span style="font-family:宋体;">亿的数据集,每天要添加和删除</span><span style="font-family:Helvetica;">16</span><span style="font-family:宋体;">亿的数据集èµ\径。äؓ了跟ítªã€æŸ¥è¯¢ã€æ¯”较数据集åQŒä»–们研发了</span><span style="font-family: Helvetica;">Google Dataset Search</span><span style="font-family:宋体;">åQ?/span><span style="font-family:Helvetica;">GOODS</span><span style="font-family:宋体;">åQ‰ã€?/span><span style="font-family:Helvetica;">GOODS</span><span style="font-family:宋体;">跟踪ç”?/span><span style="font-family:Helvetica;">API</span><span style="font-family:宋体;">暴露的元数据åQŒè¿™äº›å…ƒæ•°æ®è¢«ç”¨äºŽæ£€ç´¢ã€ç›‘控等ã€?/span></p> <p align="left"><a href="http://dl.acm.org/citation.cfm?id=2903730"><span style="font-family:Helvetica;color:#386EFF;text-decoration: none;text-underline:none">http://dl.acm.org/citation.cfm?id=2903730</span></a></p> <p> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">其他新闻</span></strong><strong></strong></p> <p><span style="font-family:Helvetica;">SiliconAngle</span><span style="font-family: 宋体;">采访äº?/span><span style="font-family:Helvetica;">Hortonworks CEO Rob Bearden</span><span style="font-family:宋体;">。主题包括业界趋åŠÑ€?/span><span style="font-family:Helvetica;">Hortonworks</span><span style="font-family:宋体;">财务ã€?/span><span style="font-family:Helvetica;">Hortonworks</span><span style="font-family: 宋体;">的非</span><span style="font-family:Helvetica;">Hadoop</span><span style="font-family:宋体;">技术以及物联网ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://siliconangle.com/blog/2016/06/24/hadoop-and-beyond-a-conversation-with-hortonworks-ceo-rob-bearden/</span></p> <p> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">产品发布</span></strong><strong></strong></p> <p align="left"><span style="font-family:Helvetica;">Apache Sentry</span><span style="font-family:宋体;">本周发布äº?/span><span style="font-family:Helvetica;">1.7.0</span><span style="font-family:宋体;">版,修复äº?/span><span style="font-family:Helvetica;">bug</span><span style="font-family:宋体;">åQŒå¢žåŠ äº†æ–°ç‰¹æ€§å’Œå…¶ä»–æ–šw¢çš„提升。本‹Æ¡å‘布把</span><span style="font-family:Helvetica;">Hive</span><span style="font-family:宋体;">授权框架升çñ”åˆîCº†½W¬äºŒç‰ˆã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://mail-archives.us.apache.org/mod_mbox/www-announce/201606.mbox/%3CCAPOmu3sDqdzu9ntDSvkMaDRQnVfHrkGV5qhyh-ZRiMmwgMMvBA@mail.gmail.com%3E</span></p> <p align="left"> </p> <p align="left"><span style="font-family:宋体;">åŸÞZºŽ</span><span style="font-family:Helvetica;">Apache Cassandra 3.0</span><span style="font-family:宋体;">构徏çš?/span><span style="font-family:Helvetica;">DataStax Enterprise 5.0</span><span style="font-family:宋体;">åQŒå¢žåŠ äº†å¯¹å›¾æ•°æ®ã€åˆ†å±‚存储ã€?/span><span style="font-family:Helvetica;">Cassandra</span><span style="font-family:宋体;">多实例的支持。本‹Æ¡å‘布也增加了诸如加密和åŸÞZºŽè§’色讉K—®æŽ§åˆ¶çš„附加安全特性支持ã€?/span></p> <p align="left"><a href="https://www.datastax.com/2016/06/introducing-datastax-enterprise-5-0"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">https://www.datastax.com/2016/06/introducing-datastax-enterprise-5-0</span></a></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Driven</span><span style="font-family:宋体;">åQŒå¤§æ•°æ®åº”用性能监控¾pȝ»Ÿå‘布äº?/span><span style="font-family:Helvetica;">2.2</span><span style="font-family:宋体;">版。本‹Æ¡å‘布的亮点是对</span><span style="font-family:Helvetica;">Apache Spark</span><span style="font-family:宋体;">的监控提供了支持ã€?/span></p> <p align="left"><a href="http://www.driven.io/2016/06/driven-inc-delivering-hadoop-spark-performance-monitoring-announces-driven-2-2/"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">http://www.driven.io/2016/06/driven-inc-delivering-hadoop-spark-performance-monitoring-announces-driven-2-2/</span></a></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">BlueData</span><span style="font-family:宋体;">发布了他们äؓ</span><span style="font-family:Helvetica;">Amazon Web Services</span><span style="font-family:宋体;">提供çš?/span><span style="font-family:Helvetica;">EPIC</span><span style="font-family:宋体;">企业大数据既服务产品。本产品通过½Ž€å•çš„点击ž®Þpƒ½è‡ªåŠ¨è£…蝲到基äº?/span><span style="font-family: Helvetica;">Docker</span><span style="font-family:宋体;">çš?/span><span style="font-family:Helvetica;">Hadoop</span><span style="font-family:宋体;">集群ã€?/span></p> <p align="left"><a href="http://www.bluedata.com/blog/2016/06/big-data-as-a-service-on-prem-or-cloud-bdaas/"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">http://www.bluedata.com/blog/2016/06/big-data-as-a-service-on-prem-or-cloud-bdaas/</span></a></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Apache Accumulo</span><span style="font-family:宋体;">发布äº?/span><span style="font-family:Helvetica;">1.7.2</span><span style="font-family:宋体;">版。本‹Æ¡å‘布修复了</span><span style="font-family:Helvetica;">write-ahead</span><span style="font-family:宋体;">日志处理方式åQŒä¼˜åŒ–了</span><span style="font-family:Helvetica;">RFiles</span><span style="font-family:宋体;">åQŒä»¥åŠæ€§èƒ½ä¸Šçš„ž®æå‡ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">https://accumulo.apache.org/release_notes/1.7.2.html</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Apache ZooKeeper</span><span style="font-family:宋体;">的顶¾U?/span><span style="font-family:Helvetica;">SDK</span><span style="font-family:宋体;">åQ?/span><span style="font-family:Helvetica;">Apache Curator</span><span style="font-family:宋体;">发布äº?/span><span style="font-family:Helvetica;">2.11.0</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">3.2.0</span><span style="font-family:宋体;">版ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">https://cwiki.apache.org/confluence/display/CURATOR/Releases#Releases-June23,2016,Releases2.11.0and3.2.0available</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Apache Hive</span><span style="font-family:宋体;">发布äº?/span><span style="font-family:Helvetica;">2.1.0</span><span style="font-family:宋体;">版。修复了大量</span><span style="font-family:Helvetica;">bug</span><span style="font-family:宋体;">和功能增强,包括å¯?/span><span style="font-family:Helvetica;">Hive</span><span style="font-family:宋体;">çš?/span><span style="font-family:Helvetica;">Live Longer</span><span style="font-family: 宋体;">å’?/span><span style="font-family:Helvetica;">Prosper </span><span style="font-family:宋体;">改进和以å?/span><span style="font-family:Helvetica;">JDBC</span><span style="font-family:宋体;">支持ã€?/span></p> <p align="left"><a href="http://mail-archives.us.apache.org/mod_mbox/www-announce/201606.mbox/%3C7194557D-CB5E-45B7-B905-82F27B7CB33F@apache.org%3E"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">http://mail-archives.us.apache.org/mod_mbox/www-announce/201606.mbox/%3C7194557D-CB5E-45B7-B905-82F27B7CB33F@apache.org%3E</span></a></p> <p align="left"> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">‹zÕdŠ¨</span></strong><strong></strong></p> <p align="left"><span style="font-size:14.0pt;font-family:SimSun;">中国</span></p> <p align="left"><span style="font-family:Helvetica;">7</span><span style="font-family:宋体;">æœ?/span><span style="font-family:Helvetica;">2</span><span style="font-family:宋体;">æ—?/span> <span style="font-family:宋体;">上æ“v</span><span style="font-family:Helvetica;">BigData Streaming</span><span style="font-family: 宋体;">½W¬ä¸‰‹Æ¡è§é¢ä¼š</span></p><img src ="http://www.qpkxbc.shop/rosen/aggbug/431174.html" width = "1" height = "1" /><br><br><div align=right><a style="text-decoration:none;" href="http://www.qpkxbc.shop/rosen/" target="_blank">Rosen</a> 2016-07-12 21:21 <a href="http://www.qpkxbc.shop/rosen/archive/2016/07/12/431174.html#Feedback" target="_blank" style="text-decoration:none;">发表评论</a></div>]]></description></item><item><title>Hadoop周刊—第 175 æœ?/title><link>http://www.qpkxbc.shop/rosen/archive/2016/07/01/431070.html</link><dc:creator>Rosen</dc:creator><author>Rosen</author><pubDate>Fri, 01 Jul 2016 07:44:00 GMT</pubDate><guid>http://www.qpkxbc.shop/rosen/archive/2016/07/01/431070.html</guid><wfw:comment>http://www.qpkxbc.shop/rosen/comments/431070.html</wfw:comment><comments>http://www.qpkxbc.shop/rosen/archive/2016/07/01/431070.html#Feedback</comments><slash:comments>0</slash:comments><wfw:commentRss>http://www.qpkxbc.shop/rosen/comments/commentRss/431070.html</wfw:commentRss><trackback:ping>http://www.qpkxbc.shop/rosen/services/trackbacks/431070.html</trackback:ping><description><![CDATA[<p align="left" style="line-height: 10%;"><strong> </strong></p> <p align="left" style="line-height: 10%;"><strong><span style="font-size:16.0pt;line-height:10%">Hadoop</span></strong><strong><span style="font-size:16.0pt;line-height:10%;font-family:宋体;">周刊</span></strong><strong> </strong><strong><span style="font-size:16.0pt;line-height: 10%;font-family:宋体;">½W?/span></strong><strong><span style="font-size:16.0pt;line-height:10%"> 175 </span></strong><strong><span style="font-size:16.0pt;line-height: 10%;font-family:宋体;">æœ?/span></strong><strong></strong></p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">启明星辰òq›_°å’Œå¤§æ•°æ®æ€ÖM½“¾l„ç¼–è¯?/span></p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"><span style="font-size:14.0pt;line-height:10%">2016</span><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">òq?/span><span style="font-size:14.0pt;line-height:10%">6</span><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">æœ?/span><span style="font-size:14.0pt;line-height:10%">19</span><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">æ—?/span></p> <p> </p> <p><span style="font-family:Helvetica;">Hadoop</span><span style="font-family:宋体;">å³îC¼šå·²è¿‡åŽÖM¸€å‘¨äº†åQŒæˆ‘们已看到有多个äñ”品(™å¹ç›®åQ‰æ•²å®šäº†å‘布旉™—´ã€‚所以在技术新闻部分,有关äº?/span><span style="font-family:Helvetica;">Hadoop Kerberos</span><span style="font-family:宋体;">认证的内容另外还æœ?/span><span style="font-family:Helvetica;">Salsify</span><span style="font-family:宋体;">应用</span><span style="font-family:Helvetica;">Avro</span><span style="font-family:宋体;">的文章。在产品发布部分åQŒåŒ…æ‹?/span><span style="font-family: Helvetica;">Yandex</span><span style="font-family:宋体;">新近开源的列式数据库在内的多个™å¹ç›®å‡æœ‰æ–°ç‰ˆæœ¬å‘布ã€?/span></p> <p> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">技术新é—?/span></strong><strong></strong></p> <p><span style="font-family:Helvetica;">OpenCore</span><span style="font-family:宋体;">博客撰文½Cø™Œƒäº†å¤š¿U?/span><span style="font-family:Helvetica;">Hadoop Kerberos</span><span style="font-family:宋体;">认证协议调试工具。尤其示范了如何使用</span><span style="font-family:Helvetica;">UserGropuInformation</span><span style="font-family:宋体;">çš?/span><span style="font-family:Helvetica;">“main()”</span><span style="font-family:宋体;">æ–ÒŽ³•å¯¼å‡ºä¸€äº›æœ‰ç”¨çš„调试信息ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://www.opencore.com/blog/2016/5/user-name-handling-in-hadoop/</span></p> <p> </p> <p><span style="font-family:Helvetica;">YARN</span><span style="font-family:宋体;">¾pÕdˆ—文章的第四部分,</span><span style="font-family: Helvetica;">Cloduera</span><span style="font-family:宋体;">博客介绍了如何配¾|®å…¬òqŒ™°ƒåº¦é˜Ÿåˆ—。尤其对资源¾U¦æŸè®„¡½®ã€é˜Ÿåˆ—安¾|®ç­–略和抢占˜q›è¡Œäº†è¯¦è§£ã€?/span></p> <p align="left"><a href="http://blog.cloudera.com/blog/2016/06/untangling-apache-hadoop-yarn-part-4-fair-scheduler-queue-basics/"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">http://blog.cloudera.com/blog/2016/06/untangling-apache-hadoop-yarn-part-4-fair-scheduler-queue-basics/</span></a></p> <p> </p> <p><span style="font-family:Helvetica;">Salsify</span><span style="font-family:宋体;">åŸÞZºŽ</span><span style="font-family:Helvetica;">Apache Kafka</span><span style="font-family:宋体;">构徏了一个异步微服务架构åQŒåƈ采用</span><span style="font-family:Helvetica;">Apache Avro</span><span style="font-family:宋体;">˜q›è¡Œæ•°æ®åºåˆ—化。该应用使用</span><span style="font-family:Helvetica;">Ruby</span><span style="font-family:宋体;">开发,他们创徏了多个新工具使得</span><span style="font-family:Helvetica;">Avro</span><span style="font-family:宋体;">能和</span><span style="font-family:Helvetica;">Ruby</span><span style="font-family:宋体;">语言很好的配合。本文介¾läº†˜q™äº›å·¥å…·å’Œå®ƒä»¬çš„ä»·å€û|¼š</span><span style="font-family:Helvetica;">avro-builder</span><span style="font-family:宋体;">用于定义记录、基äº?/span><span style="font-family:Helvetica;">postgres</span><span style="font-family:宋体;">的模式注册表åQ?/span><span style="font-family:Helvetica;">avromatic</span><span style="font-family:宋体;">则从</span><span style="font-family:Helvetica;">avro schema</span><span style="font-family:宋体;">生成模型ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://blog.salsify.com/engineering/adventures-in-avro</span></p> <p> </p> <p><span style="font-family:Helvetica;">Apache Drill</span><span style="font-family: 宋体;">可以动态推断模式,˜q˜æ”¯æŒå¤šæ¨¡å¼</span><span style="font-family: Helvetica;">(</span><span style="font-family:宋体;">但相互兼å®?/span><span style="font-family:Helvetica;">)</span><span style="font-family:宋体;">数据。这¿Uç»„合ä‹É得一些有­‘£çš„用例得以实现åQŒä¾‹å¦‚跨多个不同模式çš?/span><span style="font-family: Helvetica;">json</span><span style="font-family:宋体;">文äšg查询ã€?/span><span style="font-family:Helvetica;">MapR</span><span style="font-family:宋体;">博客探究了这些特性åƈ˜q›è¡Œäº†ç¤ºèŒƒã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://www.mapr.com/blog/sql-query-mixed-schema-data-using-apache-drill</span></p> <p> </p> <p><span style="font-family:宋体;">本教½E‹å±•½CÞZº†å¦‚何ž®?/span><span style="font-family:Helvetica;">Druid</span><span style="font-family:宋体;">ä¸?/span><span style="font-family:Helvetica;">Apache Kafka</span><span style="font-family: 宋体;">¾l“合构徏‹¹å¼åˆ†æžå’Œå¯è§†åŒ–åQˆå€ŸåŠ©</span><span style="font-family: Helvetica;">Pivot</span><span style="font-family:宋体;">åQ?/span><span style="font-family:Helvetica;">Druid</span><span style="font-family:宋体;">çš?/span><span style="font-family:Helvetica;">web UI</span><span style="font-family:宋体;">åQ‰åº”用ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://www.confluent.io/blog/building-a-streaming-analytics-stack-with-apache-kafka-and-druid</span></p> <p> </p> <p><span style="font-family:Helvetica;">Apache Beam</span><span style="font-family: 宋体;">åQˆå­µåŒ–中åQ‰åšå®¢æ’°æ–‡ä»‹¾läº†ä»–们在连æŽ?/span><span style="font-family:Helvetica;">Apache Flink</span><span style="font-family:宋体;">批处理集¾Ÿ¤æ–¹é¢çš„成果ã€?/span><span style="font-family:Helvetica;">Beam</span><span style="font-family:宋体;">是一个开æº?/span><span style="font-family:Helvetica;">SDK</span><span style="font-family:宋体;">åQŒæœ€åˆæ¥è‡ªäºŽ</span><span style="font-family:Helvetica;">Google</span><span style="font-family:宋体;">åQŒç”¨äºŽæš´éœ²åŽç«¯æœªçŸ¥æ•°æ®ç®¡é?/span><span style="font-family:Helvetica;">API</span><span style="font-family:宋体;">ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://beam.incubator.apache.org/blog/2016/06/13/flink-batch-runner-milestone.html</span></p> <p> </p> <p><span style="font-family:Helvetica;">Cask Hydrator</span><span style="font-family: 宋体;">是一个通过</span><span style="font-family:Helvetica;">UI</span><span style="font-family:宋体;">界面采用拖拽方式构徏数据½Ž¡é“的工兗÷€‚本教程也演½CÞZº†å¦‚何使用</span><span style="font-family:Helvetica;">Hydrator</span><span style="font-family:宋体;">把数据从</span><span style="font-family:Helvetica;">MySQL</span><span style="font-family:宋体;">导入åˆ?/span><span style="font-family:Helvetica;">HDFS</span><span style="font-family:宋体;">ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://blog.cask.co/2016/06/bringing-relational-data-into-data-lakes/</span></p> <p> </p> <p><span style="font-family:Helvetica;">Databricks</span><span style="font-family:宋体;">撰文介绍了即ž®†å‘布的</span><span style="font-family: Helvetica;">Apache Spark 2.0</span><span style="font-family:宋体;">中新çš?/span><span style="font-family:Helvetica;">SQL</span><span style="font-family:宋体;">子查询功能。有­‘£çš„是,本文以手册åŞ式呈玎ͼŒæœ€ç›´æˆªäº†å½“的展çŽîCº†ä»£ç å’ŒèŒƒä¾‹æ•°æ®ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://databricks.com/blog/2016/06/17/sql-subqueries-in-apache-spark-2-0.html</span></p> <p> </p> <p><span style="font-family:Helvetica;">Apache Kudu</span><span style="font-family: 宋体;">åQˆå­µåŒ–中åQ‰åšå®¢æ’°å†™äº†åœ¨å•é›†ç¾¤èŠ‚点使用</span><span style="font-family:Helvetica;">Raft</span><span style="font-family:宋体;">的文章,借此动态扩展到多主节点集群ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://getkudu.io/2016/06/17/raft-consensus-single-node.html</span></p> <p> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">其他新闻</span></strong><strong></strong></p> <p><span style="font-family:宋体;">本文指出</span><span style="font-family:Helvetica;">Apache Spark</span><span style="font-family:宋体;">½C‘ÖŒºå¦‚果不用心经营,可能会重走因¼„Žç‰‡åŒ–导è‡?/span><span style="font-family:Helvetica;">Apache Hadoop</span><span style="font-family:宋体;">生态系¾lŸæ؜ä¹Þqš„老èµ\。ä‹D例来è¯ß_¼Œæœ€æ–°ç‰ˆæœ¬çš„</span><span style="font-family:Helvetica;">CDH</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">HDP</span><span style="font-family:宋体;">支持不同版本çš?/span><span style="font-family:Helvetica;">Spark</span><span style="font-family:宋体;">ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://techcrunch.com/2016/06/12/spark-fragmentation-undermines-community/</span></p> <p> </p> <p><span style="font-family:Helvetica;">New Stack</span><span style="font-family:宋体;">撰写了一½‹‡å…³äº?/span><span style="font-family:Helvetica;">Concord</span><span style="font-family:宋体;">的文章,</span><span style="font-family:Helvetica;">Concord</span><span style="font-family:宋体;">是一个构建在</span><span style="font-family:Helvetica;">Apache Mesos</span><span style="font-family: 宋体;">上新的流式处理框æžÓž¼ˆå…¬å¼€‹¹‹è¯•çŠ¶æ€ï¼‰ã€?/span><span style="font-family:Helvetica;">Concord</span><span style="font-family:宋体;">使用</span><span style="font-family:Helvetica;">C++</span><span style="font-family:宋体;">开发,支持动态拓扑(无需停机实现½Ž¡é“的增加和减少åQ‰ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://thenewstack.io/concord-leverages-mesos-high-performance-stream-processing/</span></p> <p> </p> <p><span style="font-family:宋体;">随着</span><span style="font-family:Helvetica;">Databricks</span><span style="font-family:宋体;">½C‘ÖŒºç‰ˆçš„正式发布åQ?/span><span style="font-family:Helvetica;">Databricks</span><span style="font-family:宋体;">发布了ä‹Éç”?/span><span style="font-family:Helvetica;">Databricks</span><span style="font-family:宋体;">¾~–写</span><span style="font-family:Helvetica;">Apache Spark</span><span style="font-family:宋体;">应用½E‹åº¾pÕdˆ—教程的第一½‹‡ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://databricks.com/blog/2016/06/15/an-introduction-to-writing-apache-spark-applications-on-databricks.html</span></p> <p> </p> <p><span style="font-family:Helvetica;">Hadoop</span><span style="font-family:宋体;">圣何塞峰会于几周前召开åQŒæœŸé—´ä‹D行了题äؓ</span><span style="font-family:Helvetica;">“</span><span style="font-family:宋体;">大数据行业中的女æ€?/span><span style="font-family:Helvetica;">”</span><span style="font-family:宋体;">专场午宴ã€?/span><span style="font-family:Helvetica;">Hortonworks</span><span style="font-family: 宋体;">博客ç‰ÒŽ„é‡‡è®¿äº†åˆå®´ä¸»æŒäh</span><span style="font-family: Helvetica;">Hortonworks CMO</span><span style="font-family:宋体;">åQ?/span><span style="font-family:Helvetica;">Ingrid Burton</span><span style="font-family:宋体;">ã€?/span></p> <p align="left"><a href="http://hortonworks.com/blog/summer-hortonworks-part-2-wibd-assertive-innovative-take-risks/"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">http://hortonworks.com/blog/summer-hortonworks-part-2-wibd-assertive-innovative-take-risks/</span></a></p> <p> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">产品发布</span></strong><strong></strong></p> <p align="left"><span style="font-family:Helvetica;">Apache SystemML</span><span style="font-family:宋体;">åQˆå­µåŒ–中åQ‰æœ€˜q‘发布了</span><span style="font-family: Helvetica;">0.10.0</span><span style="font-family:宋体;">版ã€?/span><span style="font-family:Helvetica;">SystemML</span><span style="font-family:宋体;">是一个机器学习框æžÓž¼Œç”±å¤šä¸ªé¡¹ç›®åœ¨èƒŒåŽæ”¯æ’‘åQŒåŒ…æ‹?/span><span style="font-family:Helvetica;">Apache Spark</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">Apache Hadoop</span><span style="font-family:宋体;">。本‹Æ¡å‘布包括新çš?/span><span style="font-family:Helvetica;">Spark Matrix Block</span><span style="font-family:宋体;">¾cÕdž‹ã€æ”¯æŒæ·±åº¦å­¦ä¹ ã€æ€§èƒ½ä¸Šçš„提升、新çš?/span><span style="font-family:Helvetica;">KNN</span><span style="font-family:宋体;">½Ž—法½{‰ç­‰ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://systemml.apache.org/0.10.0-incubating/release_notes.html</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Apache Mahout</span><span style="font-family:宋体;">åQŒå¦ä¸€ä¸ªæœºå™¨å­¦ä¹ æ¡†æž¶å‘布了</span><span style="font-family: Helvetica;">0.12.2</span><span style="font-family:宋体;">版。本‹Æ¡å‘布向着集成</span><span style="font-family:Helvetica;">Apache Zeppelin</span><span style="font-family:宋体;">可视化和支持</span><span style="font-family:Helvetica;">notebook</span><span style="font-family:宋体;">的目标迈˜q›äº†ä¸€æ­¥ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://mail-archives.us.apache.org/mod_mbox/www-announce/201606.mbox/%3CCAOtpBjgBAuQs5FiX5X_5A+Rd-A1fVz0R7SKttGe4cJuCLRiGww@mail.gmail.com%3E</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Qubole</span><span style="font-family:宋体;">宣布他们çš?/span><span style="font-family:Helvetica;">HBase-as-a-Service</span><span style="font-family:宋体;">已经åœ?/span><span style="font-family:Helvetica;">AWS</span><span style="font-family:宋体;">上提供。它为长时运行集¾Ÿ¤æä¾›äº†è®¸å¤šæ¼‚亮的特性。支æŒ?/span><span style="font-family:Helvetica;">Hannibal</span><span style="font-family:宋体;">和其它监控工å…øP¼Œé›†æˆäº?/span><span style="font-family:Helvetica;">Apache Zeppelin</span><span style="font-family:宋体;">åQŒåƈ能通过节点引导½E‹åºä¸?/span><span style="font-family: Helvetica;">OpenTSDB</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">Apache Phoenix</span><span style="font-family:宋体;">配置ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">https://www.qubole.com/blog/product/quboles-hbase-as-a-service-is-generally-available-on-aws/</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Altiscale</span><span style="font-family:宋体;">发布äº?/span><span style="font-family:Helvetica;">Altiscale Insight Cloud</span><span style="font-family:宋体;">实时版。本¾pȝ»Ÿç”?/span><span style="font-family:Helvetica;">Apache HBase</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">Spark Streaming</span><span style="font-family:宋体;">支撑ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">https://www.altiscale.com/blog/announcing-the-altiscale-insight-cloud-real-time-edition/</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">`hs2client`</span><span style="font-family:宋体;">是一个äؓ</span><span style="font-family:Helvetica;">Apache Hive</span><span style="font-family: 宋体;">å’?/span><span style="font-family:Helvetica;">Apache Impala</span><span style="font-family:宋体;">åQˆå­µåŒ–中åQ‰æä¾›çš„æ–?/span><span style="font-family:Helvetica;">C++</span><span style="font-family:宋体;">库。除了支æŒ?/span><span style="font-family:Helvetica;">C++</span><span style="font-family:宋体;">åQŒè¿™ä¸ªåº“˜q˜ç»‘定了</span><span style="font-family:Helvetica;">python</span><span style="font-family:宋体;">åQŒå¯ä»¥åœ¨</span><span style="font-family:Helvetica;">pandas</span><span style="font-family:宋体;">中把数据è¯Õdˆ°</span><span style="font-family:Helvetica;">DataFrame</span><span style="font-family:宋体;">ã€?/span></p> <p align="left"><a href="http://blog.cloudera.com/blog/2016/06/announcing-hs2client-a-fast-new-c-python-thrift-client-for-impala-and-hive/"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">http://blog.cloudera.com/blog/2016/06/announcing-hs2client-a-fast-new-c-python-thrift-client-for-impala-and-hive/</span></a></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">MapR</span><span style="font-family:宋体;">在其发行版中支持äº?/span><span style="font-family:Helvetica;">Apache Spark 2.0</span><span style="font-family: 宋体;">开发者预览版ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">https://www.mapr.com/blog/spark-20-now-developer-preview-mode-mapr-platform</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Apache Beam</span><span style="font-family:宋体;">发布了其</span><span style="font-family:Helvetica;">0.1.0</span><span style="font-family:宋体;">孵化版,是本™å¹ç›®åŠ å…¥</span><span style="font-family: Helvetica;">Apache</span><span style="font-family:宋体;">孵化器以来首‹Æ¡å‘布ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://beam.incubator.apache.org/beam/release/2016/06/15/first-release.html</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Yandex</span><span style="font-family:宋体;">开源了</span><span style="font-family:Helvetica;">ClickHouse</span><span style="font-family:宋体;">åQŒä¸€ä¸ªåˆ—式分析数据库。本¾pȝ»Ÿä¸ºæ¨ªå‘å’Œ¾Uµå‘扩展而生。支持复杂数据类型(例如数组åQ‰å’Œ˜q‘似查询。该团队˜q˜å‘布了与其它数据库相比的基准测试结果ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">https://clickhouse.yandex/</span></p> <p align="left"> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">‹zÕdŠ¨</span></strong><strong></strong></p> <p align="left"><span style="font-size:14.0pt;font-family:SimSun;">中国</span></p> <p align="left"> </p><img src ="http://www.qpkxbc.shop/rosen/aggbug/431070.html" width = "1" height = "1" /><br><br><div align=right><a style="text-decoration:none;" href="http://www.qpkxbc.shop/rosen/" target="_blank">Rosen</a> 2016-07-01 15:44 <a href="http://www.qpkxbc.shop/rosen/archive/2016/07/01/431070.html#Feedback" target="_blank" style="text-decoration:none;">发表评论</a></div>]]></description></item><item><title>Hadoop周刊—第 174 æœ?/title><link>http://www.qpkxbc.shop/rosen/archive/2016/06/28/431032.html</link><dc:creator>Rosen</dc:creator><author>Rosen</author><pubDate>Tue, 28 Jun 2016 09:39:00 GMT</pubDate><guid>http://www.qpkxbc.shop/rosen/archive/2016/06/28/431032.html</guid><wfw:comment>http://www.qpkxbc.shop/rosen/comments/431032.html</wfw:comment><comments>http://www.qpkxbc.shop/rosen/archive/2016/06/28/431032.html#Feedback</comments><slash:comments>0</slash:comments><wfw:commentRss>http://www.qpkxbc.shop/rosen/comments/commentRss/431032.html</wfw:commentRss><trackback:ping>http://www.qpkxbc.shop/rosen/services/trackbacks/431032.html</trackback:ping><description><![CDATA[<p align="left" style="line-height: 10%;"><strong> </strong></p> <p align="left" style="line-height: 10%;"><strong><span style="font-size:16.0pt;line-height:10%">Hadoop</span></strong><strong><span style="font-size:16.0pt;line-height:10%;font-family:宋体;">周刊</span></strong><strong> </strong><strong><span style="font-size:16.0pt;line-height: 10%;font-family:宋体;">½W?/span></strong><strong><span style="font-size:16.0pt;line-height:10%"> 174 </span></strong><strong><span style="font-size:16.0pt;line-height: 10%;font-family:宋体;">æœ?/span></strong><strong></strong></p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">启明星辰òq›_°å’Œå¤§æ•°æ®æ€ÖM½“¾l„ç¼–è¯?/span></p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"><span style="font-size:14.0pt;line-height:10%">2016</span><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">òq?/span><span style="font-size:14.0pt;line-height:10%">6</span><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">æœ?/span><span style="font-size:14.0pt;line-height:10%">12</span><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">æ—?/span></p> <p> </p> <p><span style="font-family:Helvetica;">Spark</span><span style="font-family:宋体;">å³îC¼šæœ¬å‘¨åœ¨æ—§é‡‘山召开åQŒæ­£å¦‚所料,本期周刊有大量关äº?/span><span style="font-family:Helvetica;">Apache Spark</span><span style="font-family:宋体;">的新闅R€å…¬å‘Šå’Œç‰ˆæœ¬å‘布。除</span><span style="font-family:Helvetica;">Spark</span><span style="font-family:宋体;">外,本期˜q˜æœ‰</span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Cask</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Ambari</span><span style="font-family:宋体;">斚w¢çš„文章。在产品发布部分åQŒæœ‰ä¸€òq´æ¥</span><span style="font-family:Helvetica;">Apache Pig</span><span style="font-family:宋体;">首次版本更新åQŒè¿˜ä¸€ä¸ªäؓ分布式系¾lŸè®¾è®¡çš„½Ž€‹zæ–°å·¥å…·</span><span style="font-family:Helvetica;">Runway</span><span style="font-family:宋体;">åQŒæœ€åŽæ˜¯æ–°ç‰ˆ</span><span style="font-family:Helvetica;">Apache Kudu</span><span style="font-family:宋体;">åQˆå­µåŒ–中åQ‰ã€?/span></p> <p> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">技术新é—?/span></strong><strong></strong></p> <p><span style="font-family:Helvetica;">Debezium</span><span style="font-family:宋体;">是一个相对较新的™å¹ç›®åQŒç”¨äºŽæ•°æ®åº“å’?/span><span style="font-family:Helvetica;">Apache Kafka topic</span><span style="font-family:宋体;">行çñ”改变数据捕获。当面支æŒ?/span><span style="font-family:Helvetica;">MySQL</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Zookeeper</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">åQŒè¿™æ˜¯ä¸€½‹‡åœ¨</span><span style="font-family:Helvetica;">Docker</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Kubernetes</span><span style="font-family:宋体;">容器上配¾|?/span><span style="font-family:Helvetica;">Zookeeper, Kafka, MySQL</span><span style="font-family:宋体;">的教½E‹ã€?/span></p> <p align="left"><a href="http://debezium.io/blog/2016/05/31/Debezium-on-Kubernetes/"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">http://debezium.io/blog/2016/05/31/Debezium-on-Kubernetes/</span></a></p> <p> </p> <p><span style="font-family:宋体;">有些人对</span><span style="font-family:Helvetica;">Apache Kafka</span><span style="font-family:宋体;">™å¹ç›®å®£å¸ƒé‡‡ç”¨å¦ä¸€¿Uæµå¼å¤„理引擎感到惊è®Óž¼Œ˜q™å°±æ˜?/span><span style="font-family:Helvetica;">Kafka Streams</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Kafka Streams</span><span style="font-family: 宋体;">与其它系¾lŸå­˜åœ¨æ˜¾è‘—的关键差异。本文很好的½Cø™Œƒäº†è¿™äº›ä¸åŒç‚¹</span><span style="font-family:Helvetica;">——abstraction</span><span style="font-family:宋体;">、部¾|²æ¨¡åž‹ã€æ”¯æŒåŸºäºŽçŠ¶æ€çš„计算ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://softwaremill.com/kafka-streams-how-does-it-fit-stream-landscape/</span></p> <p> </p> <p><span style="font-family:宋体;">每个使用</span><span style="font-family:Helvetica;">MapReduce</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Spark</span><span style="font-family:宋体;">或类似系¾lŸçš„人都会陷入难以调试、数据特å¾?/span><span style="font-family:Helvetica;">bug</span><span style="font-family:宋体;">˜q™äº›é—®é¢˜ä¸­ã€?/span><span style="font-family:Helvetica;">BigDebug</span><span style="font-family:宋体;">æ˜?/span><span style="font-family:Helvetica;">UCLA</span><span style="font-family:宋体;">åQˆåŠ å·žå¤§å­¦æ´›æ‰çŸ¶åˆ†æ ¡åQ‰çš„研究™å¹ç›®</span><span style="font-family: Helvetica;">/</span><span style="font-family:宋体;">论文åQŒæ—¨åœ¨è®©å¼€å‘äh员通过工具发现单机问题åQšä¼ å…¥å‚数导致的崩溃åQŒè·Ÿítªã€æ–­ç‚V€è§‚察点、åšg˜qŸæŠ¥è­¦ç­‰ã€‚该工具支持</span><span style="font-family:Helvetica;">Apache Spark 1.2.1</span><span style="font-family:宋体;">上ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://blog.acolyer.org/2016/06/07/bigdebug-debugging-primitives-for-interactive-big-data-processing-in-spark/</span></p> <p> </p> <p><span style="font-family:Helvetica;">Cask</span><span style="font-family:宋体;">撰文介绍了在开æº?/span><span style="font-family:Helvetica;">Cask Data Application Platform (CDAP)</span><span style="font-family:宋体;">中运è¡?/span><span style="font-family:Helvetica;">Spark</span><span style="font-family:宋体;">的文章。运行在</span><span style="font-family:Helvetica;">CDAP</span><span style="font-family:宋体;">çš?/span><span style="font-family:Helvetica;">Spark</span><span style="font-family:宋体;">½E‹åºé€šè¿‡è®‰K—®</span><span style="font-family:Helvetica;">Apache Tephra</span><span style="font-family:宋体;">åQˆå­µåŒ–中åQ‰å®žçŽ°ç»†¾_’度事务支持。这æ øP¼Œž®Þpƒ½å¾ˆå®¹æ˜“利用快照隔¼›Õd®žçŽîC»Žä¸€ä¸ªè¡¨å¤åˆ¶åˆ°å¦ä¸€ä¸ªè¡¨çš„一致性ã€?/span><span style="font-family:Helvetica;">CDAP</span><span style="font-family:宋体;">中的</span><span style="font-family:Helvetica;">Spark</span><span style="font-family:宋体;">也能讉K—®</span><span style="font-family:Helvetica;">Cask Tracker</span><span style="font-family:宋体;">åQ?/span><span style="font-family:Helvetica;">Cask Tracker</span><span style="font-family:宋体;">提供数据血¾~˜ä¿¡æ¯ï¼ˆä»€ä¹ˆæ—¶å€™åˆ›å»ºã€ä‹É用等åQ‰ã€‚根据应用的不同åQ?/span><span style="font-family:Helvetica;">CDAP</span><span style="font-family:宋体;">工具˜q˜èƒ½å‘挥更大价倹{€?/span><strong></strong></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://blog.cask.co/2016/06/cdap-spark-prototype-to-production/</span></p> <p> </p> <p><span style="font-family:Helvetica;">IBM Hadoop Dev</span><span style="font-family: 宋体;">博客撰写了从</span><span style="font-family:Helvetica;">cURL</span><span style="font-family:宋体;">调用</span><span style="font-family:Helvetica;">Ambari REST API</span><span style="font-family:宋体;">的教½E‹ã€‚还½Cø™Œƒäº†åœ¨</span><span style="font-family:Helvetica;">vanilla</span><span style="font-family:宋体;">和启用了</span><span style="font-family:Helvetica;">kerberos</span><span style="font-family:宋体;">的集¾Ÿ¤ä¸Šå»ºç«‹ä¼šè¯åQŒåƈ为接下来的请求复用会话ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://developer.ibm.com/hadoop/2016/06/07/ambari-rest-calls-for-kerberos-enabled-clusters/</span></p> <p> </p> <p><span style="font-family:Helvetica;">Google</span><span style="font-family:宋体;">云åã^台博客撰文介¾läº†å¦‚何调试˜qè¡Œåœ?/span><span style="font-family:Helvetica;">Google Dataflow</span><span style="font-family:宋体;">上的</span><span style="font-family:Helvetica;">Apache Beam</span><span style="font-family: 宋体;">åQˆå­µåŒ–中åQ‰ä“Q务。äؓ了调试性能瓉™¢ˆåQ?/span><span style="font-family:Helvetica;">Dataflow</span><span style="font-family:宋体;">有一些有用的¾lŸè®¡æ•°æ®å’?/span><span style="font-family:Helvetica;">UI</span><span style="font-family:宋体;">来帮助ä‹É用者深入每一个步骤ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://cloud.google.com/blog/big-data/2016/06/understanding-timing-in-cloud-dataflow-pipelines</span></p> <p> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">其他新闻</span></strong><strong></strong></p> <p align="left"><span style="font-family:Helvetica;">Transaction Processing Performance Council(TPC)</span><span style="font-family:宋体;">发布äº?/span><span style="font-family:Helvetica;">TPCx-BB</span><span style="font-family:宋体;">基准‹¹‹è¯•åQŒè¯¥åŸºå‡†‹¹‹è¯•ä¸ºå¤§æ•°æ®¾pȝ»Ÿè®¾è®¡ã€‚除了衡é‡?/span><span style="font-family:Helvetica;">SQL</span><span style="font-family:宋体;">外,˜q˜å¯ä»¥å¯¹æœºå™¨å­¦ä¹ é›†ç¾¤å’Œåˆ†¾c»é—®é¢˜è¿›è¡Œæµ‹è¯•ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://www.datanami.com/2016/06/01/big-data-benchmark-gauges-hadoop-platforms/</span></p> <p align="left"> </p> <p align="left"><span style="font-family:宋体;">伦敦</span><span style="font-family:Helvetica;">Strata + Hadoop</span><span style="font-family:宋体;">世界大会两周前已召开。演讲者的专题报告和å‰ò灯片已发布到会议¾|‘站上ã€?/span></p> <p align="left"><a href="http://conferences.oreilly.com/strata/hadoop-big-data-eu/public/schedule/proceedings"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">http://conferences.oreilly.com/strata/hadoop-big-data-eu/public/schedule/proceedings</span></a></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Splice Machine</span><span style="font-family:宋体;">åQ?/span><span style="font-family:Helvetica;">Hadoop</span><span style="font-family:宋体;">上的</span><span style="font-family:Helvetica;">RDBMS</span><span style="font-family:宋体;">构徏者,宣布开源他们的软äšg。当前,他们正在å¯ÀL‰¾è´¡çŒ®è€?/span><span style="font-family:Helvetica;">/</span><span style="font-family:宋体;">导师</span><span style="font-family:Helvetica;">/</span><span style="font-family:宋体;">豪杰来提升开源后的效果ã€?/span><span style="font-family:Helvetica;">Splice Machine</span><span style="font-family:宋体;">有不ž®‘有­‘£çš„ç‰ÒŽ€§ï¼Œä¾‹å¦‚</span><span style="font-family:Helvetica;">ACID</span><span style="font-family:宋体;">事务åQŒäºŒ¾U§çƒ¦å¼•ï¼Œå¼•ç”¨å®Œæ•´æ€§ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://www.splicemachine.com/were_going_open_source/</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Altiscale</span><span style="font-family:宋体;">博客¾~–辑了许多关于客æˆähœåŠ¡ã€æƒ…感分析、气候变化、智慧城市ã€?/span><span style="font-family: Helvetica;">bias</span><span style="font-family:宋体;">½{‰æ–¹é¢çš„大数据应用案例文章。还攉™›†äº†ä¸€äº›å¤§æ•°æ®æ€€ç–‘论者的文章ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">https://www.altiscale.com/blog/big-data-news-health-and-public-safety-sentiment-analysis-fixing-education-2/</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Spark</span><span style="font-family:宋体;">å³îC¼šæœ¬å‘¨åœ¨æ—§é‡‘山召开。会议组¾l‡è€?/span><span style="font-family:Helvetica;">Databricks</span><span style="font-family:宋体;">概述了两天内的热点内容,链接了许多的演讲和专题报告ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">https://databricks.com/blog/2016/06/08/another-record-setting-spark-summit.html</span></p> <p align="left"> </p> <p align="left"><span style="font-family:"MS Mincho";MS Mincho";">大数据即æœ?/span><span style="font-family:SimSun;">åŠ?/span><span style="font-family:"MS Mincho";MS Mincho";">åQˆBDaaSåQ‰å…¬å?/span><span style="font-family:Helvetica;">Qubole</span><span style="font-family:宋体;">åQŒæ’°æ–‡ä»‹¾läº†ä»–们的客户如何接受ä‹Éç”?/span><span style="font-family:Helvetica;">Spark</span><span style="font-family:宋体;">。接受速度之快</span><span style="font-family:Helvetica;">——</span><span style="font-family:宋体;">一半多的客æˆïLŽ°åœ¨å¼€å§‹ç”¨</span><span style="font-family:Helvetica;">Spark</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Qubole</span><span style="font-family:宋体;">也支æŒ?/span><span style="font-family:Helvetica;">Presto</span><span style="font-family:宋体;">åQŒä»–们也看到了类似的增长ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">https://www.qubole.com/blog/big-data/spark-usage/</span></p> <p align="left"> </p> <p><span style="font-family:Helvetica;">Twitter</span><span style="font-family:宋体;">å?/span><span style="font-family:Helvetica;">Apache</span><span style="font-family:宋体;">孵化器提交了他们的复制日志服åŠ?/span><span style="font-family:Helvetica;">DistributedLog</span><span style="font-family:宋体;">ã€?/span></p> <p align="left"><a href="https://wiki.apache.org/incubator/DistributedLogProposal"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">https://wiki.apache.org/incubator/DistributedLogProposal</span></a></p> <p> </p> <p><span style="font-family:Helvetica;">Big Data Day LA</span><span style="font-family: 宋体;">äº?/span><span style="font-family:Helvetica;">6</span><span style="font-family:宋体;">æœ?/span><span style="font-family:Helvetica;">9</span><span style="font-family:宋体;">日在</span><span style="font-family:宋体;color:#2E2E2E;">西洛杉矶学院召开。这‹Æ¡æ´»åŠ¨æ˜¯å…è´¹çš„(如果预先注册的话åQ‰ï¼Œæ¼”讲者来自于</span><span style="font-family:Helvetica;">Confluent</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Databricks</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Yahoo</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Netflix</span><span style="font-family:宋体;">½{‰ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://www.bigdatadayla.com/</span></p> <p> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">产品发布</span></strong><strong></strong></p> <p align="left"><span style="font-family:Helvetica;">Apache Spark</span><span style="font-family:宋体;">发布äº?/span><span style="font-family:Helvetica;">Spark 2.0</span><span style="font-family:宋体;">预览版。发布声明中说道</span><span style="font-family:Helvetica;">API</span><span style="font-family:宋体;">和功能都ž®šæœªæœ€¾lˆæ•²å®šã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">https://spark.apache.org/news/spark-2.0.0-preview.html</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">JustOne</span><span style="font-family:宋体;">构徏òq¶å¼€æºäº†</span><span style="font-family:Helvetica;">Kafka-to-PostgreSQL</span><span style="font-family:宋体;">˜qžæŽ¥å™¨ã€‚本文介¾läº†è¯¥è¿žæŽ¥å™¨çš„性能åQŒè¯¦¾l†æ˜qîCº†å¦‚何把消息è{换äؓ行,˜q˜æ˜qîCº†å¦‚何讑֮šé…ç½®½{‰ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://www.confluent.io/blog/kafka-connect-sink-for-postgresql-from-justone-database</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Salesforce</span><span style="font-family:宋体;">开源了</span><span style="font-family:Helvetica;">Runway</span><span style="font-family:宋体;">åQŒè¿™æ˜¯ä¸€ä¸ªå¾æ¨¡ã€ä»¿çœŸä»¥åŠå¯è§†åŒ–分布式系¾lŸã€‚在</span><span style="font-family:Helvetica;">runway.system</span><span style="font-family:宋体;">上有一个在¾U¿æ¼”½CºçŽ¯å¢ƒï¼Œæ¼”示äº?/span><span style="font-family:Helvetica;">“too many bananas”</span><span style="font-family:宋体;">模型åQŒç”µæ¢¯ç³»¾lŸå’Œ</span><span style="font-family:Helvetica;">Raft</span><span style="font-family:宋体;">一致性系¾lŸã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">https://medium.com/salesforce-open-source/runway-intro-dc0d9578e248</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Bloomberg</span><span style="font-family:宋体;">最˜q‘开源了</span><span style="font-family:Helvetica;">Presto Accumulo</span><span style="font-family: 宋体;">åQŒé¢å?/span><span style="font-family:Helvetica;">Apache Accumulo</span><span style="font-family:宋体;">çš?/span><span style="font-family:Helvetica;">Presto</span><span style="font-family:宋体;">˜qžæŽ¥å™¨ã€‚在声明中,链接äº?/span><span style="font-family:Helvetica;">11</span><span style="font-family:宋体;">™å늚„论文åQŒæ¯”较了åŸÞZºŽçš?/span><span style="font-family:Helvetica;">Presto</span><span style="font-family:宋体;">查询和基äº?/span><span style="font-family:Helvetica;">Accumulo Java API</span><span style="font-family:宋体;">查询的基准测试结果ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://www.bloomberg.com/company/announcements/open-source-at-bloomberg-reducing-application-development-time-via-presto-accumulo/</span></p> <p align="left"> </p> <p align="left"><span style="font-family:"MS Mincho";MS Mincho";">å¾?/span><span style="font-family:SimSun;">è½?/span><span style="font-family:Helvetica;">Azure</span><span style="font-family:宋体;">发布了基äº?/span><span style="font-family:Helvetica;">Apache Spark 1.6.1 </span><span style="font-family:宋体;">½E›_®šç‰ˆçš„</span><span style="font-family:Helvetica;">Azure HDInsight</span><span style="font-family:宋体;">。本‹Æ¡å‘布支持了面向</span><span style="font-family:Helvetica;">Spark</span><span style="font-family:宋体;">çš?/span><span style="font-family:Helvetica;">Project Livy REST</span><span style="font-family: 宋体;">ä»ÕdŠ¡æœåŠ¡æ”¯æŒåQŒé›†æˆäº†</span><span style="font-family: Helvetica;">Azure</span><span style="font-family:宋体;">数据湖存储(åŸÞZºŽè§’色的访问控åˆÓž¼‰åQŒé›†æˆäº†</span><span style="font-family:Helvetica;">IntelliJ</span><span style="font-family:宋体;">åQŒæ”¯æŒäº†</span><span style="font-family:Helvetica;">Jupyter</span><span style="font-family:宋体;">½W”记本等ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">https://azure.microsoft.com/en-us/blog/apache-spark-for-azure-hdinsight-now-generally-available/</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">LinkedIn</span><span style="font-family:宋体;">开源了</span><span style="font-family:Helvetica;">Photon ML</span><span style="font-family:宋体;">åQŒä»–们的大规模回归分析库ã€?/span><span style="font-family: Helvetica;">Photon</span><span style="font-family:宋体;">构徏åœ?/span><span style="font-family:Helvetica;">Spark</span><span style="font-family:宋体;">之上òq¶åœ¨</span><span style="font-family:Helvetica;">LinkedIn</span><span style="font-family:宋体;">çš?/span><span style="font-family:Helvetica;">YARN</span><span style="font-family:宋体;">上运行(˜q‡åŽ»åŸÞZºŽ</span><span style="font-family:Helvetica;">MapReduce</span><span style="font-family:宋体;">åQŒä¼¼ä¹Žå› ä¸ø™¦æå‡æ€§èƒ½æ‰è¿¿U»ï¼‰ã€?/span></p> <p align="left"><a href="https://engineering.linkedin.com/blog/2016/06/open-sourcing-photon-ml"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">https://engineering.linkedin.com/blog/2016/06/open-sourcing-photon-ml</span></a></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Hortonworks</span><span style="font-family:宋体;">发布äº?/span><span style="font-family:Helvetica;">Spark-HBase</span><span style="font-family: 宋体;">˜qžæŽ¥å™¨çš„技术预览版。预览版原生支持</span><span style="font-family:Helvetica;">Avro</span><span style="font-family:宋体;">åQŒæ”¯æŒè¿è¡Œå®‰å…¨é›†¾Ÿ¤ï¼ŒåŽŸç”Ÿæ”¯æŒ</span><span style="font-family:Helvetica;">Spark Datasource API</span><span style="font-family:宋体;">åQŒåƈ优化了分åŒÞZ¿®å‰ªï¼Œåˆ—修剪,谓词下推ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://hortonworks.com/blog/spark-hbase-dataframe-based-hbase-connector/</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Databricks</span><span style="font-family:宋体;">发布äº?/span><span style="font-family:Helvetica;">Apache Spark</span><span style="font-family: 宋体;">òq›_°çš„第一阶段安全ç‰ÒŽ€§ã€‚本阶段寚w›†¾Ÿ?/span><span style="font-family:Helvetica;">ACL</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">SAML 2.0</span><span style="font-family:宋体;">˜q›è¡Œäº†æ”¯æŒï¼Œç«¯å¯¹ç«¯çš„审计日志ã€?/span></p> <p align="left"><span style="font-family:Helvetica;color:#386EFF;">https://databricks.com/blog/2016/06/08/achieving-end-to-end-security-for-apache-spark-with-databricks.html</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Apache ORC 1.1.0</span><span style="font-family:宋体;">版发布了。本‹Æ¡å‘布完成了从基äº?/span><span style="font-family: Helvetica;">Apache Hive</span><span style="font-family:宋体;">的代码到åŸÞZºŽ</span><span style="font-family:Helvetica;">Java</span><span style="font-family:宋体;">的代码迁¿U»ï¼Œä¿®æ­£äº?/span><span style="font-family:Helvetica;">C++</span><span style="font-family:宋体;">旉™—´æˆ›_¤„理程序,增加äº?/span><span style="font-family: Helvetica;">Hadoop MapReduce</span><span style="font-family:宋体;">˜qžæŽ¥å™¨ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://orc.apache.org/news/2016/06/10/ORC-1.1.0/</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Apache Kudu</span><span style="font-family:宋体;">发布äº?/span><span style="font-family:Helvetica;">0.9.0</span><span style="font-family:宋体;">版。增加了</span><span style="font-family:Helvetica;">UPSERT</span><span style="font-family:宋体;">命ä×oåQŒæ–°çš?/span><span style="font-family:Helvetica;">Spark</span><span style="font-family:宋体;">数据源不会依èµ?/span><span style="font-family:Helvetica;">MapReduce API</span><span style="font-family: 宋体;">åQŒæå‡äº†</span><span style="font-family:Helvetica;">Tablet Server</span><span style="font-family:宋体;">写性能ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://getkudu.io/2016/06/10/apache-kudu-0-9-0-released.html</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Google</span><span style="font-family:宋体;">云服务åã^台团队发布了支持</span><span style="font-family:Helvetica;">Spark 2.0</span><span style="font-family:宋体;">预览版的</span><span style="font-family:Helvetica;">Google Cloud Dataproc</span><span style="font-family: 宋体;">ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">https://cloud.google.com/blog/big-data/2016/06/google-cloud-dataproc-the-fast-easy-and-safe-way-to-try-spark-20-preview</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Dory</span><span style="font-family:宋体;">åQ?/span><span style="font-family:Helvetica;">Bruce</span><span style="font-family:宋体;">的ç‘ô承者)</span><span style="font-family:Helvetica;">Kafka producer</span><span style="font-family:宋体;">的守护进½E‹ï¼ŒçŽ°åœ¨æ”¯æŒä»?/span><span style="font-family:Helvetica;">UNIX domain sockets</span><span style="font-family:宋体;">或本åœ?/span><span style="font-family:Helvetica;">TCP</span><span style="font-family:"MS Mincho";MS Mincho";">接收数据了ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://mail-archives.apache.org/mod_mbox/kafka-users/201606.mbox/%3C1465683894.608424023@apps.rackspace.com%3E</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Apache Pig 0.16.0</span><span style="font-family:宋体;">版,一òq´æ¥é¦–次发布。坚定了å¯?/span><span style="font-family: Helvetica;">Tez</span><span style="font-family:宋体;">的支持ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://pig.apache.org/releases.html#8+June%2C+2016%3A+release+0.16.0+available</span></p> <p align="left"> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">‹zÕdŠ¨</span></strong><strong></strong></p> <p align="left"><span style="font-size:14.0pt;font-family:SimSun;">中国</span></p> <p align="left"><span style="font-family:Helvetica;">Spark Meetup (</span><span style="font-family:宋体;">上æ“v</span><span style="font-family:Helvetica;">) – </span><span style="font-family:宋体;">周六</span><span style="font-family:Helvetica;">, 6</span><span style="font-family:宋体;">æœ?/span><span style="font-family:Helvetica;">18</span><span style="font-family:宋体;">æ—?/span></p><img src ="http://www.qpkxbc.shop/rosen/aggbug/431032.html" width = "1" height = "1" /><br><br><div align=right><a style="text-decoration:none;" href="http://www.qpkxbc.shop/rosen/" target="_blank">Rosen</a> 2016-06-28 17:39 <a href="http://www.qpkxbc.shop/rosen/archive/2016/06/28/431032.html#Feedback" target="_blank" style="text-decoration:none;">发表评论</a></div>]]></description></item><item><title>Hadoop周刊—第 173 æœ?/title><link>http://www.qpkxbc.shop/rosen/archive/2016/06/20/430972.html</link><dc:creator>Rosen</dc:creator><author>Rosen</author><pubDate>Mon, 20 Jun 2016 01:47:00 GMT</pubDate><guid>http://www.qpkxbc.shop/rosen/archive/2016/06/20/430972.html</guid><wfw:comment>http://www.qpkxbc.shop/rosen/comments/430972.html</wfw:comment><comments>http://www.qpkxbc.shop/rosen/archive/2016/06/20/430972.html#Feedback</comments><slash:comments>0</slash:comments><wfw:commentRss>http://www.qpkxbc.shop/rosen/comments/commentRss/430972.html</wfw:commentRss><trackback:ping>http://www.qpkxbc.shop/rosen/services/trackbacks/430972.html</trackback:ping><description><![CDATA[<p align="left" style="line-height: 10%;"><strong> </strong></p> <p align="left" style="line-height: 10%;"><strong><span style="font-size:16.0pt;line-height:10%">Hadoop</span></strong><strong><span style="font-size:16.0pt;line-height:10%;font-family:宋体;">周刊</span></strong><strong> </strong><strong><span style="font-size:16.0pt;line-height: 10%;font-family:宋体;">½W?/span></strong><strong><span style="font-size:16.0pt;line-height:10%"> 173 </span></strong><strong><span style="font-size:16.0pt;line-height: 10%;font-family:宋体;">æœ?/span></strong><strong></strong></p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">启明星辰òq›_°å’Œå¤§æ•°æ®æ€ÖM½“¾l„ç¼–è¯?/span></p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"><span style="font-size:14.0pt;line-height:10%">2016</span><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">òq?/span><span style="font-size:14.0pt;line-height:10%">6</span><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">æœ?/span><span style="font-size:14.0pt;line-height:10%">5</span><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">æ—?/span></p> <p> </p> <p><span style="font-family:宋体;">本周åQ?/span><span style="font-family:Helvetica;">Spark</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">NiFi</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Netflix Meson</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Storm</span><span style="font-family:宋体;">斚w¢åªæœ‰ž®‘量内容ã€?/span><span style="font-family:Helvetica;">Spark</span><span style="font-family:宋体;">å³îC¼šæœ¬å‘¨åœ¨æ—§é‡‘山召开åQŒæ‰€ä»¥å‘¢åQŒä¸‹å‘¨è‚¯å®šæœ‰ä¸å°‘内容ã€?/span></p> <p> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">技术新é—?/span></strong><strong></strong></p> <p><span style="font-family:Helvetica;">Databricks</span><span style="font-family:宋体;">博客介绍äº?/span><span style="font-family:Helvetica;">Apache Spark 2.0</span><span style="font-family:宋体;">的新ç‰ÒŽ€?/span><span style="font-family:Helvetica;">——</span><span style="font-family:宋体;">跨语­a€æ”¯æŒå­˜å‚¨å’ŒåŠ è½½æœºå™¨å­¦ä¹ æ¨¡åž‹ã€‚模型通过½Ž€å•çš„</span><span style="font-family:Helvetica;">API</span><span style="font-family:宋体;">被存储和加蝲åQŒæ¨¡åž‹çš„元数据与参数保存ä¸?/span><span style="font-family:Helvetica;">JSON</span><span style="font-family:宋体;">风格åQŒæ¨¡åž‹çš„数据保存ä¸?/span><span style="font-family:Helvetica;">Parquet</span><span style="font-family:宋体;">风格ã€?/span></p> <p><span style="font-family:Helvetica;">https://databricks.com/blog/2016/05/31/apache-spark-2-0-preview-machine-learning-model-persistence.html</span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://databricks.com/blog/2016/05/31/apache-spark-2-0-preview-machine-learning-model-persistence.html</span></p> <p> </p> <p><span style="font-family:Helvetica;">Meson</span><span style="font-family:宋体;">æ˜?/span><span style="font-family:Helvetica;">Netflix</span><span style="font-family:宋体;">用于执行机器学习工作‹¹çš„框架。它æ˜?/span><span style="font-family:Helvetica;">Apache Hive</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Spark</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Mesos</span><span style="font-family:宋体;">˜q™äº›å¤§æ•°æ®æŠ€æœ¯ä¹‹é—´çš„¾_˜åˆå‰‚。工作流使用</span><span style="font-family:Helvetica;">DSL</span><span style="font-family:宋体;">˜q›è¡Œ¾~–写åQ?/span><span style="font-family:Helvetica;">Meson</span><span style="font-family:宋体;">˜q˜æä¾›äº†æ›´åŠ å…ˆè¿›çš„流水线可视åŒ?/span><span style="font-family: Helvetica;">UI</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Netflix</span><span style="font-family:宋体;">目前没开æº?/span><span style="font-family:Helvetica;">Meson</span><span style="font-family:宋体;">åQŒä½†ä»–们有这斚w¢çš„计划ã€?/span></p> <p align="left"><a href="http://techblog.netflix.com/2016/05/meson_31.html"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">http://techblog.netflix.com/2016/05/meson_31.html</span></a></p> <p> </p> <p><span style="font-family:Helvetica;">IBM Hadoop Dev</span><span style="font-family: 宋体;">博客½Ž€è¦ä»‹¾lå’Œ½Cø™Œƒäº?/span><span style="font-family: Helvetica;">HDFS</span><span style="font-family:宋体;">归档存储能力ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://developer.ibm.com/hadoop/2016/06/01/use-hdfs-archival-storage/</span></p> <p> </p> <p><span style="font-family:Helvetica;">Apache Storm 1.0</span><span style="font-family: 宋体;">有了令äh惊讶的新ç‰ÒŽ€§ã€‚本文关注了几个调试能力斚w¢çš„增强:动态日志çñ”别、统一日志搜烦ã€?/span><span style="font-family:Cambria;">事äšg抽样、集æˆ?/span><span style="font-family: Helvetica;">jstack/heap dumps/java</span><span style="font-family:宋体;">飞行记录器分æž?/span><span style="font-family:Helvetica;">worker</span><span style="font-family:宋体;">ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://hortonworks.com/blog/whats-new-apache-storm-1-0-part-1-enhanced-debugging/</span></p> <p> </p> <p><span style="font-family:Helvetica;">Cloudera</span><span style="font-family:宋体;">博客撰文介绍了如何ä‹Éç”?/span><span style="font-family: Helvetica;">Apache Spark</span><span style="font-family:宋体;">来探索性分析存储在</span><span style="font-family:Helvetica;">CSV</span><span style="font-family:宋体;">文äšg中的</span><span style="font-family:Helvetica;">NBA</span><span style="font-family:宋体;">历史¾lŸè®¡æ•°æ®ã€‚分析过½E‹æ؜合ä‹É用了</span><span style="font-family: Helvetica;">Scala</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">SQL</span><span style="font-family:宋体;">ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://blog.cloudera.com/blog/2016/06/how-to-analyze-fantasy-sports-using-apache-spark-and-sql/</span></p> <p> </p> <p><span style="font-family:Helvetica;">Apache NiFi</span><span style="font-family: 宋体;">作äؓ一¿Ué€šç”¨å·¥å…·å—到了很多的å…Ïx³¨ã€‚它ä¸?/span><span style="font-family:Helvetica;">“</span><span style="font-family:宋体;">åŸÞZºŽ‹¹ç¨‹çš„处ç?/span><span style="font-family:Helvetica;">”</span><span style="font-family:宋体;">而生åQŒå¯èƒ½å¯¹å¾ˆå¤šäººåƈ不意味着什么,ä½?/span><span style="font-family:Helvetica;">NiFi</span><span style="font-family:宋体;">支持标准çš?/span><span style="font-family:Helvetica;">ETL</span><span style="font-family:宋体;">åQŒæµå¼å¤„理等。许å¤?/span><span style="font-family:Helvetica;">NiFi</span><span style="font-family:宋体;">例子都示范了如何ä»?/span><span style="font-family:Helvetica;">Twitter firehose</span><span style="font-family:宋体;">把数据移动到</span><span style="font-family:Helvetica;">HDFS</span><span style="font-family:宋体;">中,但本文聚焦在</span><span style="font-family:Helvetica;">NiFi</span><span style="font-family:宋体;">另外的特性上</span><span style="font-family:Helvetica;">——</span><span style="font-family:宋体;">½Cø™Œƒäº†ä¸€äº›ç®€å•çš„ä»?/span><span style="font-family:Helvetica;">HTTP</span><span style="font-family:宋体;">拉数据的˜q‡ç¨‹ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://hortonworks.com/blog/apache-nifi-not-scratch/</span></p> <p> </p> <p><span style="font-family:Helvetica;">Amazon Redshift</span><span style="font-family: 宋体;">构徏äº?/span><span style="font-family:Helvetica;">PostgreSQL</span><span style="font-family:宋体;">引擎上,所以你可以利用</span><span style="font-family:Helvetica;">PostgreSQL</span><span style="font-family:宋体;">的扩展功能让</span><span style="font-family:Helvetica;">Redshift</span><span style="font-family:宋体;">集群˜qžæŽ¥</span><span style="font-family:Helvetica;">PostgresSQL</span><span style="font-family:宋体;">实例。这样一来,诸如跨数据库˜qžæŽ¥ã€å°†</span><span style="font-family:Helvetica;">Redshift</span><span style="font-family:宋体;">的结果è{换äؓ</span><span style="font-family:Helvetica;">JSON</span><span style="font-family:宋体;">、在</span><span style="font-family:Helvetica;">Postgres</span><span style="font-family:宋体;">中创å»?/span><span style="font-family:Helvetica;">Redshift</span><span style="font-family:宋体;">数据视图ã€?/span></p> <p><span style="font-family:宋体;">数据库之间复制数据等有趣的应用都能实现ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://blogs.aws.amazon.com/bigdata/post/Tx1GQ6WLEWVJ1OX/JOIN-Amazon-Redshift-AND-Amazon-RDS-PostgreSQL-WITH-dblink</span></p> <p> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">其他发布</span></strong><strong></strong></p> <p align="left"><span style="font-family:Helvetica;">FeatherCast</span><span style="font-family:宋体;">发布了超˜q?/span><span style="font-family:Helvetica;">100</span><span style="font-family:宋体;">ä¸?/span><span style="font-family:Helvetica;">ApacheCon</span><span style="font-family:宋体;">北美å³îC¼šçš„相兛_½•éŸŸë€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://feathercast.apache.org/tag/apacheconna2016/</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">InfoWorld</span><span style="font-family:宋体;">介绍äº?/span><span style="font-family:Helvetica;">Heron</span><span style="font-family:宋体;">åQ?/span><span style="font-family:Helvetica;">Twitter</span><span style="font-family:宋体;">才开源的</span><span style="font-family:Helvetica;">Apache Storm</span><span style="font-family:宋体;">兼容™å¹ç›®ã€‚本文介¾läº†ä¸¤ä¸ª™å¹ç›®åœ¨æž¶æž„上的不同。主要指å‡ÞZº†</span><span style="font-family:Helvetica;">Heron</span><span style="font-family:宋体;">èµäh­¥äºŽå‡ ä¸ªæœˆå‰ï¼ˆ</span><span style="font-family:Helvetica;">Storm</span><span style="font-family:宋体;">已发布)åQŒå°±æ˜¯è¯´</span><span style="font-family:Helvetica;">Storm</span><span style="font-family:宋体;">在特性上æ¯?/span><span style="font-family:Helvetica;">Heron</span><span style="font-family:宋体;">更有优势ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://www.infoworld.com/article/3078134/analytics/had-it-with-apache-storm-heron-swoops-to-the-rescue.html</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Databricks</span><span style="font-family:宋体;">åœ?/span><span style="font-family:Helvetica;">edX</span><span style="font-family:宋体;">上开了一门新评¡¨‹åQ?/span><span style="font-family:Helvetica;">“Apache Spark</span><span style="font-family:宋体;">入门</span><span style="font-family:Helvetica;">”</span><span style="font-family:宋体;">。课½E‹ä»Ž</span><span style="font-family:Helvetica;">6</span><span style="font-family:宋体;">æœ?/span><span style="font-family:Helvetica;">15</span><span style="font-family:宋体;">日开始,一直持¾l­ä¸¤å‘¨ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">launch-first-of-five-free-big-data-courses-on-apache-spark.html</span></p> <p> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">产品发布</span></strong><strong></strong></p> <p align="left"><span style="font-family:Helvetica;">Amazon EMR</span><span style="font-family:宋体;">发布äº?/span><span style="font-family:Helvetica;">4.7.0</span><span style="font-family:宋体;">版。本‹Æ¡å‘布支持了</span><span style="font-family:Helvetica;">Apache Tez</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">Apache Phoenix</span><span style="font-family:宋体;">åQŒåƈ内置了新版本çš?/span><span style="font-family:Helvetica;">Apache HBase</span><span style="font-family: 宋体;">ã€?/span><span style="font-family:Helvetica;">Apache Mahout</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Presto</span><span style="font-family:宋体;">。另外,</span><span style="font-family:Helvetica;">AWS</span><span style="font-family:宋体;">大数据博客还指导äº?/span><span style="font-family:Helvetica;">Phoenix</span><span style="font-family:宋体;">如何上手ã€?/span></p> <p align="left"><a href="http://aws.amazon.com/blogs/aws/amazon-emr-4-7-0-apache-tez-phoenix-updates-to-existing-apps/"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">http://aws.amazon.com/blogs/aws/amazon-emr-4-7-0-apache-tez-phoenix-updates-to-existing-apps/</span></a></p> <p align="left"><a href="http://blogs.aws.amazon.com/bigdata/post/Tx2ZF1NDQYDJFGT/Supercharge-SQL-on-Your-Data-in-Apache-HBase-with-Apache-Phoenix"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">http://blogs.aws.amazon.com/bigdata/post/Tx2ZF1NDQYDJFGT/Supercharge-SQL-on-Your-Data-in-Apache-HBase-with-Apache-Phoenix</span></a></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Apache Hive</span><span style="font-family:宋体;">本周发布äº?/span><span style="font-family:Helvetica;">2.0.1</span><span style="font-family:宋体;">版。从二月发布</span><span style="font-family:Helvetica;">2.0.0</span><span style="font-family:宋体;">以来åQŒé¦–‹Æ¡å°ç‰ˆæœ¬å‘布。本‹Æ¡ä¿®å¤äº†</span><span style="font-family:Helvetica;">60</span><span style="font-family:宋体;">ä¸?/span><span style="font-family:Helvetica;">bug</span><span style="font-family:宋体;">ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://mail-archives.us.apache.org/mod_mbox/www-announce/201605.mbox/%3CD37344A3.77A64%25sershe@apache.org%3E</span></p> <p align="left"> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">‹zÕdŠ¨</span></strong><strong></strong></p> <p align="left"><span style="font-size:14.0pt;font-family:SimSun;">中国</span></p> <p align="left"><span style="font-family:宋体;">æ—?/span></p><img src ="http://www.qpkxbc.shop/rosen/aggbug/430972.html" width = "1" height = "1" /><br><br><div align=right><a style="text-decoration:none;" href="http://www.qpkxbc.shop/rosen/" target="_blank">Rosen</a> 2016-06-20 09:47 <a href="http://www.qpkxbc.shop/rosen/archive/2016/06/20/430972.html#Feedback" target="_blank" style="text-decoration:none;">发表评论</a></div>]]></description></item><item><title>Hadoop周刊—第 172 æœ?/title><link>http://www.qpkxbc.shop/rosen/archive/2016/06/09/430841.html</link><dc:creator>Rosen</dc:creator><author>Rosen</author><pubDate>Wed, 08 Jun 2016 16:11:00 GMT</pubDate><guid>http://www.qpkxbc.shop/rosen/archive/2016/06/09/430841.html</guid><wfw:comment>http://www.qpkxbc.shop/rosen/comments/430841.html</wfw:comment><comments>http://www.qpkxbc.shop/rosen/archive/2016/06/09/430841.html#Feedback</comments><slash:comments>0</slash:comments><wfw:commentRss>http://www.qpkxbc.shop/rosen/comments/commentRss/430841.html</wfw:commentRss><trackback:ping>http://www.qpkxbc.shop/rosen/services/trackbacks/430841.html</trackback:ping><description><![CDATA[<p align="left" style="line-height: 10%;"><strong> </strong></p> <p align="left" style="line-height: 10%;"><strong><span style="font-size:16.0pt;line-height:10%">Hadoop</span></strong><strong><span style="font-size:16.0pt;line-height:10%;font-family:宋体;">周刊</span></strong><strong> </strong><strong><span style="font-size:16.0pt;line-height: 10%;font-family:宋体;">½W?/span></strong><strong><span style="font-size:16.0pt;line-height:10%"> 172 </span></strong><strong><span style="font-size:16.0pt;line-height: 10%;font-family:宋体;">æœ?/span></strong><strong></strong></p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">启明星辰òq›_°å’Œå¤§æ•°æ®æ€ÖM½“¾l„ç¼–è¯?/span></p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"><span style="font-size:14.0pt;line-height:10%">2016</span><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">òq?/span><span style="font-size:14.0pt;line-height:10%">5</span><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">æœ?/span><span style="font-size:14.0pt;line-height:10%">22</span><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">æ—?/span></p> <p> </p> <p><span style="font-family:宋体;">本周主要å…Ïx³¨‹¹å¼è®¡ç®—</span><span style="font-family:Helvetica;">—— Twitter</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">Cloudera</span><span style="font-family:宋体;">介绍了他们新的流式计½Ž—框æžÓž¼Œæœ‰æ–‡ç« ä»‹¾läº†</span><span style="font-family:Helvetica;">Apache Flink</span><span style="font-family:宋体;">的流å¼?/span><span style="font-family:Helvetica;">SQL</span><span style="font-family:宋体;">åQ?/span><span style="font-family:Helvetica;">DataTorrent</span><span style="font-family: 宋体;">介绍äº?/span><span style="font-family:Helvetica;">Apache Apex</span><span style="font-family:宋体;">定w”™æœºåˆ¶åQŒè¿˜æœ?/span><span style="font-family:Helvetica;">Concord</span><span style="font-family:宋体;">˜q™æ ·æ–°çš„‹¹å¼è®¡ç®—框架åQŒå¦å¤–还æœ?/span><span style="font-family:Helvetica;">Apache Kafka</span><span style="font-family:宋体;">çš?/span><span style="font-family:Helvetica;">0.10</span><span style="font-family:宋体;">版。其他新é—ÀL–¹é¢ï¼Œ</span><span style="font-family:Helvetica;">Apache</span><span style="font-family:宋体;">孵化器有新动å?/span><span style="font-family:Helvetica;">——Apache TinkerPop</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">Apache Zeppelin</span><span style="font-family:宋体;">孵化成äؓ™å¶çñ”™å¹ç›®åQ?/span><span style="font-family:Helvetica;">Tephra</span><span style="font-family:宋体;">˜q›å…¥å­µåŒ–器。除了上˜q°å†…容,</span><span style="font-family: Helvetica;">Apache Spark</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Apache HBase</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Apache Drill</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Apache Ambari</span><span style="font-family:宋体;">½{‰ä¹Ÿæœ‰æ–°æ–‡ç« ã€?/span></p> <p> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">技术新é—?/span></strong><strong></strong></p> <p align="left"><span style="font-family:Helvetica;">DataTorrent</span><span style="font-family:宋体;">博客撰文介绍äº?/span><span style="font-family:Helvetica;">Apache Apex</span><span style="font-family:宋体;">在读写数据文件时的容错机制ã€?/span><span style="font-family:Helvetica;">Apex</span><span style="font-family:宋体;">是专门处理流式数据的åQŒæµå¼è®¡½Ž—有一些微妙但重要的细节需要考虑。例如ä‹Éç”?/span><span style="font-family:Helvetica;">HDFS</span><span style="font-family:宋体;">输出æ—Óž¼Œ</span><span style="font-family:Helvetica;">HDFS</span><span style="font-family:宋体;">的租¾U¦æœºåˆ¶ä¼šå¼•å‘问题ã€?/span></p> <p align="left"><a href="https://www.datatorrent.com/blog/fault-tolerant-file-processing/"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">https://www.datatorrent.com/blog/fault-tolerant-file-processing/</span></a></p> <p> </p> <p><span style="font-family:Helvetica;">Databricks</span><span style="font-family:宋体;">博客介绍äº?/span><span style="font-family:Helvetica;">Spark 2.0</span><span style="font-family:宋体;">ä¸?/span><span style="font-family:Helvetica;">Tungsten</span><span style="font-family:宋体;">代码生成引擎带来的性能提升。博文ä‹D例说明了ç”׃ºŽè™šæ‹Ÿå‡½æ•°çš„管理,更好地利ç”?/span><span style="font-family:Helvetica;">CPU</span><span style="font-family:宋体;">寄存器和循环展开åQŒæ‰€ä»¥ä»£ç ç”Ÿæˆå¼•æ“Žèƒ½æ›´å¿«çš„生成代码。除äº?/span><span style="font-family: Helvetica;">Databricks</span><span style="font-family:宋体;">的博文外åQ?/span><span style="font-family:Helvetica;">Morning Paper</span><span style="font-family:宋体;">˜q˜è°ˆåˆîC»¥ä¸ŠæŠ€æœ¯å…¶å®žæ˜¯å—到</span><span style="font-family: Helvetica;">VLDB</span><span style="font-family:宋体;">论文的启发ã€?/span></p> <p align="left"><a href="https://databricks.com/blog/2016/05/23/apache-spark-as-a-compiler-joining-a-billion-rows-per-second-on-a-laptop.html"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">https://databricks.com/blog/2016/05/23/apache-spark-as-a-compiler-joining-a-billion-rows-per-second-on-a-laptop.html</span></a></p> <p><a href="https://blog.acolyer.org/2016/05/23/efficiently-compiling-efficient-query-plans-for-modern-hardware/"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">https://blog.acolyer.org/2016/05/23/efficiently-compiling-efficient-query-plans-for-modern-hardware/</span></a></p> <p> </p> <p><span style="font-family:Helvetica;">StreamScope</span><span style="font-family: 宋体;">是微软流式处理系¾lŸï¼Œæ˜?/span><span style="font-family: Helvetica;">Morning Paper</span><span style="font-family:宋体;">本周撰写的另一个流式计½Ž—文章。介¾läº†è¯¥ç³»¾lŸçš„特征</span><span style="font-family:Helvetica;">——</span><span style="font-family:宋体;">吞吐é‡?/span><span style="font-family:Helvetica;">/</span><span style="font-family:宋体;">集群大小、编½E‹æ¨¡åž?/span><span style="font-family:Helvetica;">(SQL)</span><span style="font-family:宋体;">、时间模型、语义学</span><span style="font-family:Helvetica;">/</span><span style="font-family:宋体;">保证åQŒä»¥åŠå¾®è½¯äñ”品中的应用ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://blog.acolyer.org/2016/05/24/streamscope-continuous-reliable-distributed-processing-of-big-data-streams/</span></p> <p> </p> <p><span style="font-family:Helvetica;">Apache</span><span style="font-family:宋体;">博客撰文介绍äº?/span><span style="font-family:Helvetica;">HubSpot</span><span style="font-family:宋体;">团队å¯?/span><span style="font-family:Helvetica;">Apache HBase</span><span style="font-family:宋体;">çš?/span><span style="font-family:Helvetica;">G1GC</span><span style="font-family:宋体;">调优斚w¢çš„经验。本文回™å?/span><span style="font-family:Helvetica;">HubSpot</span><span style="font-family:宋体;">如何ž®è¯•å’Œä¿éšœç¨³å®šæ€§ã€å¦‚何保éš?/span><span style="font-family:Helvetica;">99%</span><span style="font-family:宋体;">的性能、如何羃短花在垃圑֛žæ”¶ä¸Šçš„时间。该团队使用很多技巧,很好地决¾läº†é”™ç»¼å¤æ‚çš?/span><span style="font-family:Helvetica;">GC</span><span style="font-family:宋体;">½Ž—法。本文最后,˜q˜ä¸€æ­¥æ­¥½Cø™Œƒäº?/span><span style="font-family:Helvetica;">HBase</span><span style="font-family:宋体;">çš?/span><span style="font-family:Helvetica;">G1GC</span><span style="font-family:宋体;">调优ã€?/span></p> <p align="left"><a href="https://blogs.apache.org/hbase/entry/tuning_g1gc_for_your_hbase"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">https://blogs.apache.org/hbase/entry/tuning_g1gc_for_your_hbase</span></a></p> <p> </p> <p><span style="font-family:Helvetica;">LinkedIn</span><span style="font-family:宋体;">撰文阐述了调è¯?/span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">偏移量管理问题的诸多困难。本文聚焦了两个所è°?/span><span style="font-family:Helvetica;">"offset rewind"</span><span style="font-family: Cambria;">事äšg的症çŠÓž¼Œå¦‚何在监控过½E‹ä¸­‹‚€‹¹‹åˆ°˜q™ç±»äº‹äšgåQŒä»¥åŠå¯¼è‡´è¿™ä¸¤ä¸ªäº‹äšg的根本原因(及解å†Ïx–¹æ¡ˆï¼‰ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://engineering.linkedin.com/blog/2016/05/kafkaesque-days-at-linkedin--part-1</span></p> <p> </p> <p><span style="font-family:Helvetica;">Databricks</span><span style="font-family:宋体;">博客发布了ä‹Éç”?/span><span style="font-family:Helvetica;">Apache Spark</span><span style="font-family:宋体;">˜q›è¡ŒåŸºå› å˜å¼‚分析¾pÕdˆ—文章的第三部分也是最后一½‹‡ã€‚本文从准备åQˆæŠŠæ–‡äšg转换åˆ?/span><span style="font-family:Helvetica;">Parquet</span><span style="font-family:宋体;">òq¶åŠ è½½è¿›</span><span style="font-family:Helvetica;">Spark RRD</span><span style="font-family:宋体;">åQ‰åˆ°å¦‚何加蝲基因型数据再到运è¡?/span><span style="font-family: Helvetica;">kmeans</span><span style="font-family:宋体;">聚类½Ž—法åŸÞZºŽåŸºå› åž‹ç‰¹å¾é¢„‹¹‹åœ°ç†ç§¾Ÿ¤ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://databricks.com/blog/2016/05/24/predicting-geographic-population-using-genome-variants-and-k-means.html</span></p> <p> </p> <p><span style="font-family:宋体;">许多批处理大数据生态系¾lŸå·²ä»Žè‡ªå®šä¹‰</span><span style="font-family:Helvetica;">API</span><span style="font-family:宋体;">回到</span><span style="font-family:Helvetica;">SQL</span><span style="font-family:宋体;">上,所以如果流式处理框架也发生了同æ ïLš„变化åQŒä¸€å®šå¾ˆæœ‰è¶£ã€‚本文,</span><span style="font-family:Helvetica;">Apache Flink</span><span style="font-family:宋体;">团队介绍他们计划支持‹¹å¼</span><span style="font-family:Helvetica;">SQL</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Flink</span><span style="font-family:宋体;">已经有了</span><span style="font-family:Helvetica;">Table API</span><span style="font-family:宋体;">åQŒä»–们利ç”?/span><span style="font-family:Helvetica;">Apache Calcite</span><span style="font-family:宋体;">提供了对</span><span style="font-family:Helvetica;">SQL</span><span style="font-family:宋体;">的支持。对äº?/span><span style="font-family:Helvetica;">windowing</span><span style="font-family:宋体;">åQŒä»–们计划用</span><span style="font-family:Helvetica;">Calcite</span><span style="font-family:宋体;">的流å¼?/span><span style="font-family:Helvetica;">SQL</span><span style="font-family:宋体;">扩展。最初对</span><span style="font-family:Helvetica;">SQL</span><span style="font-family:宋体;">的支持将åœ?/span><span style="font-family:Helvetica;">1.1.0</span><span style="font-family:宋体;">版中体现åQŒåœ¨</span><span style="font-family:Helvetica;">1.2.0</span><span style="font-family:宋体;">版加强ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://flink.apache.org/news/2016/05/24/stream-sql.html</span></p> <p> </p> <p><span style="font-family:宋体;">本文介绍äº?/span><span style="font-family:Helvetica;">Apache Drill</span><span style="font-family:宋体;">çš?/span><span style="font-family:Helvetica;">XML</span><span style="font-family:宋体;">插äšg。尽½Ž¡è¿˜æ²¡æœ‰å’?/span><span style="font-family:Helvetica;">Drill</span><span style="font-family:宋体;">集成在一èµøP¼Œä½†å®ƒç›¸å½“å®ÒŽ˜“被编译成</span><span style="font-family:Helvetica;">jar</span><span style="font-family:宋体;">和配¾|®å¯¹</span><span style="font-family:Helvetica;">XML</span><span style="font-family:宋体;">的支持ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://www.mapr.com/blog/how-use-xml-plugin-apache-drill</span></p> <p> </p> <p><span style="font-family:Helvetica;">Hortonworks</span><span style="font-family: 宋体;">博客½Ž€ç•¥ä»‹¾läº†</span><span style="font-family:Helvetica;">Ambari</span><span style="font-family:宋体;">监控度量¾pȝ»Ÿçš„架构,最˜q‘加入了</span><span style="font-family:Helvetica;">Grafana</span><span style="font-family:宋体;">作äؓ其前端äÈA表盘。该¾pȝ»Ÿä½¿ç”¨</span><span style="font-family:Helvetica;">Apache Phoenix</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">Apache HBase</span><span style="font-family:宋体;">作äؓ存储支撑åQŒæ‰€ä»¥æ˜¯å¯ä»¥æ¨ªå‘扩展的ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://hortonworks.com/blog/hood-ambari-metrics-grafana/</span></p> <p> </p> <p><span style="font-family:宋体;">˜q™ç¯‡æ•™ç¨‹ä»‹ç»äº†æ€Žæ ·åœ?/span><span style="font-family:Helvetica;">Amazon EMR</span><span style="font-family:宋体;">上ä‹Éç”?/span><span style="font-family:Helvetica;">Spark SQL</span><span style="font-family:宋体;">ä¸?/span><span style="font-family:Helvetica;">Hue</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Apache Zeppelin</span><span style="font-family:宋体;">配合˜qè¡Œ</span><span style="font-family:Helvetica;">SQL</span><span style="font-family:宋体;">查询存储åœ?/span><span style="font-family:Helvetica;">S3</span><span style="font-family:宋体;">中跨制表½W¦åˆ†å‰²çš„数据。本文最后展½CÞZº†å¦‚何ä»?/span><span style="font-family:Helvetica;">Spark</span><span style="font-family:宋体;">å?/span><span style="font-family:Helvetica;">DynamoDB</span><span style="font-family:宋体;">存储数据ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://blogs.aws.amazon.com/bigdata/post/Tx2D93GZRHU3TES/Using-Spark-SQL-for-ETL</span></p> <p> </p> <p><span style="font-family:Helvetica;">Heroku</span><span style="font-family:宋体;">团队分äín了他们ä‹É用最新版</span><span style="font-family: Helvetica;">Apache Kafka</span><span style="font-family:宋体;">的体éª?/span><span style="font-family:Helvetica;">——</span><span style="font-family:宋体;">才引入的</span><span style="font-family:Helvetica;">timestamp</span><span style="font-family:宋体;">字段åQ?/span><span style="font-family:Helvetica;">8</span><span style="font-family:宋体;">字节åQ‰ä¼šå¯ÆD‡´ä¸€äº›åç›´è§‰çš„性能变化ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://engineering.heroku.com/blogs/2016-05-27-apache-kafka-010-evaluating-performance-in-distributed-systems/</span></p> <p> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">其他新闻</span></strong><strong></strong></p> <p><span style="font-family:Helvetica;">O'Reilly</span><span style="font-family:宋体;">数据播客¿U€ž®?/span><span style="font-family:Helvetica;">Spark 2.0</span><span style="font-family:宋体;">中结构化‹¹å¼è®¡ç®—æ–šw¢çš„问题采访了来自</span><span style="font-family:Helvetica;">Databricks</span><span style="font-family:宋体;">çš?/span><span style="font-family:Helvetica;">Michael Armbrust</span><span style="font-family: 宋体;">。网站上的一½‹‡æ–‡ç« é€‰æ‹©å¼•ç”¨äº†å…¶ä¸­çš„话题</span><span style="font-family:Helvetica;">—— Spark SQL</span><span style="font-family:宋体;">、结构化‹¹å¼è®¡ç®—的目标、端到端½Ž¡é“的保证、对在线处理˜qç”¨</span><span style="font-family:Helvetica;">Spark</span><span style="font-family:宋体;">机器学习½Ž—法ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://www.oreilly.com/ideas/structured-streaming-comes-to-apache-spark-2-0</span></p> <p> </p> <p><span style="font-family:宋体;">本周两个大数据项目从</span><span style="font-family:Helvetica;">Apache</span><span style="font-family:宋体;">孵化器孵化完æˆ?/span><span style="font-family:Helvetica;">——Apache TinkerPop</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">Apache Zeppelin</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">TinkerPop</span><span style="font-family:宋体;">是图计算框架åQ?/span><span style="font-family:Helvetica;">Zeppelin</span><span style="font-family:宋体;">是面向数据分析基äº?/span><span style="font-family:Helvetica;">web</span><span style="font-family:宋体;">çš?/span><span style="font-family:Helvetica;">notebook</span><span style="font-family:宋体;">ã€?/span></p> <p align="left"><a href="https://blogs.apache.org/foundation/entry/the_apache_software_foundation_announces91"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">https://blogs.apache.org/foundation/entry/the_apache_software_foundation_announces91</span></a></p> <p><a href="https://blogs.apache.org/foundation/entry/the_apache_software_foundation_announces92"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">https://blogs.apache.org/foundation/entry/the_apache_software_foundation_announces92</span></a></p> <p> </p> <p><span style="font-family:Helvetica;">Tephra</span><span style="font-family:宋体;">åQ?/span><span style="font-family:Helvetica;">HBase</span><span style="font-family:宋体;">的事务引擎进入了</span><span style="font-family:Helvetica;">Apache</span><span style="font-family:宋体;">孵化器ã€?/span><span style="font-family:Helvetica;">Tephra</span><span style="font-family:宋体;">最初由</span><span style="font-family:Helvetica;">Cask</span><span style="font-family:宋体;">的团队创建,目前仅和</span><span style="font-family:Helvetica;">Apache Phoenix</span><span style="font-family:宋体;">˜q›è¡Œäº†é›†æˆã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://blog.cask.co/2016/05/tephra-a-transaction-engine-for-hbase-moves-to-apache-incubation/</span></p> <p> </p> <p><span style="font-family:Helvetica;">TechRepublic</span><span style="font-family: 宋体;">撰文介绍äº?/span><span style="font-family:Helvetica;">Concord.io</span><span style="font-family:宋体;">åQŒä¸€ä¸ªç”±</span><span style="font-family:Helvetica;">C++</span><span style="font-family:宋体;">开发的‹¹å¼å¤„理框架。旨在填补高性能‹¹å¼è®¡ç®—市场的空¾~ºã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://www.techrepublic.com/article/could-concord-topple-apache-spark-from-its-big-data-throne/</span></p> <p> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">产品发布</span></strong><strong></strong></p> <p align="left"><span style="font-family:Helvetica;">Apache Avro</span><span style="font-family:宋体;">本周发布äº?/span><span style="font-family:Helvetica;">1.8.1</span><span style="font-family:宋体;">版。修复了­‘…过</span><span style="font-family:Helvetica;">20</span><span style="font-family:宋体;">ä¸?/span><span style="font-family:Helvetica;">bug</span><span style="font-family:宋体;">和一些其它进步ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://mail-archives.us.apache.org/mod_mbox/www-announce/201605.mbox/%3CCAO4re1nYMm79WQ2LUeODWjHmJ9EiYOF=mty6p2aiq-S_4R95iQ@mail.gmail.com%3E</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Confluent</span><span style="font-family:宋体;">发布了基äº?/span><span style="font-family:Helvetica;">librdkafka</span><span style="font-family:宋体;">开发的</span><span style="font-family:Helvetica;">Kafka Python</span><span style="font-family:宋体;">客户端ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">https://pypi.python.org/pypi/confluent-kafka/0.9.1.1</span></p> <p align="left"> </p> <p align="left"><span style="font-family:"MS Mincho";MS Mincho";">伴随着新的</span><span style="font-family:Helvetica;">Kafka </span><span style="font-family:宋体;">‹¹å¼è®¡ç®—方式åQ?/span><span style="font-family:Helvetica;">Apache Kafka 0.10</span><span style="font-family:宋体;">版发布了。新版本支持了机架感知和消息中的</span><span style="font-family:Helvetica;">timestamp</span><span style="font-family:宋体;">åQŒæå‡äº†</span><span style="font-family:Helvetica;">SASL</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">Kafka Connect</span><span style="font-family:宋体;">½{‰ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://mail-archives.us.apache.org/mod_mbox/www-announce/201605.mbox/%3CCAPuboUuRyCRxDp5CLjv2yVM77SpYFF+HdnBeiiyeumYTJNpY4g@mail.gmail.com%3E</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Confluent</span><span style="font-family:宋体;">发布了基äº?/span><span style="font-family:Helvetica;">Apache Kafka 0.10</span><span style="font-family: 宋体;">çš?/span><span style="font-family:Helvetica;">Confluent Platform 3.0</span><span style="font-family:宋体;">版。除äº?/span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">的核心特性,</span><span style="font-family:Helvetica;">Confluent Platform</span><span style="font-family:宋体;">˜q˜æœ‰ä¸€ä¸ªå•†ä¸šç»„件äؓ</span><span style="font-family:Helvetica;">Kafka Connect</span><span style="font-family:宋体;">提供配置工具和端到端‹¹ç›‘控ã€?/span></p> <p align="left"><a href="http://www.confluent.io/blog/announcing-apache-kafka-0.10-and-confluent-platform-3.0"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">http://www.confluent.io/blog/announcing-apache-kafka-0.10-and-confluent-platform-3.0</span></a></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Apache Kylin</span><span style="font-family:宋体;">åQŒå¤§æ•°æ®</span><span style="font-family:Helvetica;">OLAP</span><span style="font-family:宋体;">引擎åQŒå‘布了</span><span style="font-family:Helvetica;">1.5.2</span><span style="font-family:宋体;">版。作ä¸ÞZ¸€‹Æ¡è¡¥ä¸çñ”的发布,</span><span style="font-family:Helvetica;">1.5.2</span><span style="font-family:宋体;">有不ž®‘æ–°ç‰ÒŽ€?/span><span style="font-family:Helvetica;">/</span><span style="font-family:宋体;">提升</span><span style="font-family:Helvetica;">/bug</span><span style="font-family:宋体;">修复åQŒåŒ…括支æŒ?/span><span style="font-family:Helvetica;">CDH 5.7</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">MapR</span><span style="font-family:宋体;">ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://mail-archives.us.apache.org/mod_mbox/www-announce/201605.mbox/%3CCA+LQBaTDxb4wVYVvtOC22gMbJ0p9cvhAWzEY_x2n1oNGvEDPSQ@mail.gmail.com%3E</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Twitter</span><span style="font-family:宋体;">开源了他们的流式处理系¾l?/span><span style="font-family:Helvetica;">Heron</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Heron</span><span style="font-family:宋体;">æ˜?/span><span style="font-family:Helvetica;">Twitter</span><span style="font-family:宋体;">用于替换</span><span style="font-family:Helvetica;">Apache Storm</span><span style="font-family: 宋体;">的äñ”品,发力点在性能、调试以及开发äh员生产率ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">https://blog.twitter.com/2016/open-sourcing-twitter-heron</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Envelope</span><span style="font-family:宋体;">是来自于</span><span style="font-family:Helvetica;">Cloudera Labs</span><span style="font-family: 宋体;">的新™å¹ç›®åQŒå®ƒæä¾›äº†åŸºäºŽé…¾|®æ–‡ä»¶çš„‹¹å¼</span><span style="font-family:Helvetica;">ETL</span><span style="font-family:宋体;">处理˜q‡ç¨‹ã€‚构建在</span><span style="font-family:Helvetica;">Spark streaming</span><span style="font-family:宋体;">之上åQ?/span><span style="font-family:Helvetica;">Envelope</span><span style="font-family:宋体;">最˜q‘正在研发面å?/span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">Kudu</span><span style="font-family:宋体;">的连接器ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://blog.cloudera.com/blog/2016/05/new-in-cloudera-labs-envelope-for-apache-spark-streaming/</span></p> <p align="left"> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">‹zÕdŠ¨</span></strong><strong></strong></p> <p align="left"><span style="font-size:14.0pt;font-family:SimSun;">中国</span></p> <p align="left"><span style="font-family:Helvetica;">Spark Meetup 4 (</span><span style="font-family:宋体;">杭州</span><span style="font-family:Helvetica;">) – </span><span style="font-family:宋体;">周日</span><span style="font-family:Helvetica;">, 6</span><span style="font-family:宋体;">æœ?/span><span style="font-family:Helvetica;">5</span><span style="font-family:宋体;">æ—?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://www.meetup.com/Hangzhou-Apache-Spark-Meetup/events/231071384/</span></p><img src ="http://www.qpkxbc.shop/rosen/aggbug/430841.html" width = "1" height = "1" /><br><br><div align=right><a style="text-decoration:none;" href="http://www.qpkxbc.shop/rosen/" target="_blank">Rosen</a> 2016-06-09 00:11 <a href="http://www.qpkxbc.shop/rosen/archive/2016/06/09/430841.html#Feedback" target="_blank" style="text-decoration:none;">发表评论</a></div>]]></description></item><item><title>Hadoop周刊—第 171 æœ?/title><link>http://www.qpkxbc.shop/rosen/archive/2016/06/08/430838.html</link><dc:creator>Rosen</dc:creator><author>Rosen</author><pubDate>Wed, 08 Jun 2016 08:42:00 GMT</pubDate><guid>http://www.qpkxbc.shop/rosen/archive/2016/06/08/430838.html</guid><wfw:comment>http://www.qpkxbc.shop/rosen/comments/430838.html</wfw:comment><comments>http://www.qpkxbc.shop/rosen/archive/2016/06/08/430838.html#Feedback</comments><slash:comments>0</slash:comments><wfw:commentRss>http://www.qpkxbc.shop/rosen/comments/commentRss/430838.html</wfw:commentRss><trackback:ping>http://www.qpkxbc.shop/rosen/services/trackbacks/430838.html</trackback:ping><description><![CDATA[<p align="left" style="line-height: 10%;"><strong> </strong></p> <p align="left" style="line-height: 10%;"><strong><span style="font-size:16.0pt;line-height:10%">Hadoop</span></strong><strong><span style="font-size:16.0pt;line-height:10%;font-family:宋体;">周刊</span></strong><strong> </strong><strong><span style="font-size:16.0pt;line-height: 10%;font-family:宋体;">½W?/span></strong><strong><span style="font-size:16.0pt;line-height:10%"> 171 </span></strong><strong><span style="font-size:16.0pt;line-height: 10%;font-family:宋体;">æœ?/span></strong><strong></strong></p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">启明星辰òq›_°å’Œå¤§æ•°æ®æ€ÖM½“¾l„ç¼–è¯?/span></p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"><span style="font-size:14.0pt;line-height:10%">2016</span><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">òq?/span><span style="font-size:14.0pt;line-height:10%">5</span><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">æœ?/span><span style="font-size:14.0pt;line-height:10%">22</span><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">æ—?/span></p> <p> </p> <p><span style="font-family:宋体;">本周åQŒåŒ…æ‹?/span><span style="font-family:Helvetica;">LinkedIn</span><span style="font-family:宋体;">新开源项目在内的几个™å¹ç›®éƒ½æœ‰ç‰ˆæœ¬å‘布。在技术新é—Õd’Œå…¶ä»–新闻斚w¢åQŒå¤š½‹‡æ–‡ç« å›ž™å¾äº†</span><span style="font-family:Helvetica;">Apache: Big Data North America</span><span style="font-family:宋体;">会议åQŒå¦å¤–有一¾l„è·¨­‘Šå¤šä¸ªä¸åŒæ•°æ®ç³»¾lŸåˆ†æžçº½¾U¦å‡º¿UŸèžR数据的系列文章ã€?/span></p> <p> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">技术新é—?/span></strong><strong></strong></p> <p><span style="font-family:Helvetica;">Databricks</span><span style="font-family:宋体;">博客分析äº?/span><span style="font-family:Helvetica;">Apache Spark</span><span style="font-family:宋体;">中两¿Ué€ÆD¿‘½Ž—法。之一åQ?/span><span style="font-family:Helvetica;">“approxCountDistict”</span><span style="font-family:宋体;">是用来评ä¼îC¸åŒå€¼çš„数量åQ›ä¹‹äºŒï¼Œ</span><span style="font-family: Helvetica;">“approxQuantile”</span><span style="font-family:宋体;">用于生成é€ÆD¿‘癑ֈ†æ¯”。本文介¾läº†½Ž—法和可视化¾_‘Öº¦ä¸åŒçš„残差ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://databricks.com/blog/2016/05/19/approximate-algorithms-in-apache-spark-hyperloglog-and-quantiles.html</span></p> <p> </p> <p><span style="font-family:宋体;">本教½E‹æ˜qîCº†å¦‚何使用</span><span style="font-family:Helvetica;">Apache Hadoop HDFS</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Apache Solr</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Hue</span><span style="font-family:宋体;">存储、烦引、查è¯?/span><span style="font-family:Helvetica;">DICOM</span><span style="font-family:宋体;">格式的医学媄像。文章诏½I¿äº†åŠ è²å’ŒèŽ·å–数据的整个步骤ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://blog.cloudera.com/blog/2016/05/how-to-process-and-index-medical-images-with-apache-hadoop-and-apache-solr/</span></p> <p> </p> <p><span style="font-family:Helvetica;">MapR Streams</span><span style="font-family: 宋体;">是一ä¸?/span><span style="font-family:Helvetica;">API</span><span style="font-family:宋体;">兼容</span><span style="font-family:Helvetica;">Apache Kafka</span><span style="font-family:宋体;">的系¾lŸã€‚本文在宏观上比较了</span><span style="font-family:Helvetica;">MapR Streams</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">的异同。同旉™˜æ˜Žäº†</span><span style="font-family:Helvetica;">Kafka Streams</span><span style="font-family:宋体;">怎样å’?/span><span style="font-family:Helvetica;">MapR Streams</span><span style="font-family:宋体;">扯上关系的ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://www.mapr.com/blog/apache-kafka-and-mapr-streams-terms-techniques-and-new-designs</span></p> <p> </p> <p><span style="font-family:宋体;">本文在我看来是最清晰介绍</span><span style="font-family:Helvetica;">Paxos</span><span style="font-family:宋体;">的文章之一åQ?/span><span style="font-family:Helvetica;">Paxos</span><span style="font-family:宋体;">为分布式¾pȝ»Ÿæž„徏了一致性协议。本文用¾l˜å›¾è®¡ç®—机和分布式拍卖示范了˜q™ä¸ªåè®®ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://ifeanyi.co/posts/understanding-consensus/</span></p> <p> </p> <p><span style="font-family:宋体;">åŸÞZºŽ</span><span style="font-family:Helvetica;">Apache: Big Data North America</span><span style="font-family:宋体;">会议上的一½‹‡æ¼”讌Ӏ?/span><span style="font-family:Helvetica;">Datanami</span><span style="font-family:宋体;">½H¥æŽ¢äº†å³ž®†å‘布的</span><span style="font-family:Helvetica;">Apache Hadoop 3</span><span style="font-family: 宋体;">的新ç‰ÒŽ€§ã€‚包括,</span><span style="font-family:Helvetica;">shell</span><span style="font-family:宋体;">脚本重写、ä“Q务集本地优化、内存大ž®è‡ªåŠ¨äŽ×¾~©èƒ½åŠ›ã€æ”¯æŒ?/span><span style="font-family:Helvetica;">HDFS erasure codings</span><span style="font-family:宋体;">。本文着重在</span><span style="font-family:Helvetica;">erasure codings</span><span style="font-family:宋体;">上,文章密切å…Ïx³¨äº?/span><span style="font-family:Helvetica;">erasure codings</span><span style="font-family:宋体;">在存储效率方面的提升åQ?/span><span style="font-family: Helvetica;">3x</span><span style="font-family:宋体;">¼‚ç›˜æ¶ˆè€—降低到</span><span style="font-family:Helvetica;">1.5x</span><span style="font-family:宋体;">åQ‰ã€?/span></p> <p align="left"><a href="http://www.datanami.com/2016/05/18/hadoop-3-poised-boost-storage-capacity-resilience-erasure-coding/"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">http://www.datanami.com/2016/05/18/hadoop-3-poised-boost-storage-capacity-resilience-erasure-coding/</span></a></p> <p> </p> <p><span style="font-family:宋体;">˜q™ç¯‡æ¼”讲来自äº?/span><span style="font-family:Helvetica;">PyData</span><span style="font-family:宋体;">柏林会议åQŒæ˜qîCº†</span><span style="font-family:Helvetica;">Apache Arrow</span><span style="font-family: 宋体;">å’?/span><span style="font-family:Helvetica;">Feather</span><span style="font-family:宋体;">文äšg格式åQŒæŽ¢½I¶äº†æ•°æ®åœ¨è·¨è¯­è¨€</span><span style="font-family:Helvetica;">/</span><span style="font-family:宋体;">框架互操作性的工作机制ã€?/span></p> <p align="left"><a href="http://www.slideshare.net/wesm/python-data-ecosystem-thoughts-on-building-for-the-future"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">http://www.slideshare.net/wesm/python-data-ecosystem-thoughts-on-building-for-the-future</span></a></p> <p> </p> <p><span style="font-family:宋体;">发布了两个来自于不同会议ä¸?/span><span style="font-family:Helvetica;">Apache Kafka</span><span style="font-family:宋体;">有关的演讲视频。第一个讨è®ÞZº†</span><span style="font-family: Helvetica;">Kafka</span><span style="font-family:宋体;">的安全特性,½W¬äºŒä¸ªæŽ¢ç´¢äº†</span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">如何跨系¾lŸå…±äº«æ•°æ®ã€?/span></p> <p align="left"><a href="https://www.oreilly.com/learning/securing-apache-kafka"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">https://www.oreilly.com/learning/securing-apache-kafka</span></a></p> <p><a href="https://www.infoq.com/presentations/event-streams-kafka"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">https://www.infoq.com/presentations/event-streams-kafka</span></a></p> <p> </p> <p><span style="font-family:宋体;">˜q™ç¯‡åšå®¢é›†æˆäº†æ•°½‹‡åˆ©ç”?/span><span style="font-family:Helvetica;">Amazon Redshift</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Google BigQuery</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Postgres</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Presto</span><span style="font-family:宋体;">数据¾pȝ»ŸåŠ è²</span><span style="font-family:Helvetica;">/</span><span style="font-family:宋体;">查询¾U½çº¦å‡ºç§Ÿè½¦æ•°æ®çš„文章。除了原始基准测试,˜q˜è¯¦¾l†ä»‹¾läº†å¦‚何处理故障、优化、比较替代方案(</span><span style="font-family:Helvetica;">AWS</span><span style="font-family:宋体;">çš?/span><span style="font-family:Helvetica;">S3</span><span style="font-family:宋体;">ä¸?/span><span style="font-family:Helvetica;">HDFS</span><span style="font-family:宋体;">比)ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://tech.marksblogg.com/all-billion-nyc-taxi-rides-redshift.html</span></p> <p> </p> <p><span style="font-family:Helvetica;">O'Reilly</span><span style="font-family:宋体;">撰文介绍了通过</span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Flink</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Elasticsearch</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Kibana</span><span style="font-family:宋体;">怎样实现</span><span style="font-family:Helvetica;">kappa</span><span style="font-family:宋体;">架构。文章概˜qîCº†</span><span style="font-family:Helvetica;">lambda</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">kappa</span><span style="font-family:宋体;">架构åQŒä»‹¾läº†ä¸»è¦çš„架构组ä»Óž¼Œä»¥åŠæ€Žæ ·è®„¡½®ä½¿ç”¨è´å¶æ–¯æ¨¡åž‹å‘现新奇事物ã€?/span></p> <p align="left"><a href="https://www.oreilly.com/ideas/applying-the-kappa-architecture-in-the-telco-industry"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">http://www.oreilly.com/ideas/applying-the-kappa-architecture-in-the-telco-industry</span></a></p> <p> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">其他新闻</span></strong><strong></strong></p> <p><span style="font-family:宋体;">本文列ä‹D了最˜q‘在</span><span style="font-family:Helvetica;">Apache: Big Data North America</span><span style="font-family:宋体;">会议上提到的几个大数据生态系¾lŸé¡¹ç›®ã€‚有不少是我们没¾U›_…¥è§†çº¿çš„内宏V€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://www.datanami.com/2016/05/11/open-source-tour-de-force-apache-big-data-2016/</span></p> <p> </p> <p><span style="font-family:Helvetica;">Pivotal</span><span style="font-family:宋体;">博客有一½‹‡å…³äºŽå¤§æ•°æ®å’Œæ•æ·å¼€å‘有­‘£çš„文章。大数据¾pȝ»Ÿå¾€å¾€åœç•™åœ¨éžæ•æ·çš„世界,例如在装载数据前需求要攉™›†åˆîC½åQŒæ¨¡åž‹è¦å®šä¹‰å¥½ã€‚本文认为,没有在云环境中经˜q‡é•¿æœŸéªŒè¯çš„话,要对˜q™ç§æ–¹å¼˜q›è¡Œ¾U¦æŸåQˆæœ‰é™çš„能力和性能、竖井式数据½{‰ï¼‰ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://blog.pivotal.io/big-data-pivotal/features/when-it-comes-to-big-data-cloud-and-agility-go-hand-in-hand</span></p> <p> </p> <p><span style="font-family:Helvetica;">Databricks</span><span style="font-family:宋体;">发布了他们记录的¾|‘络会议视频</span><span style="font-family: Helvetica;">“Apache Spark MLlib: From Quick Start to Scikit-Learn”</span><span style="font-family:宋体;">。除了视频内容,他们˜q˜åœ¨ä¼šè®®ä¸­è§£½{”了八个常见问题ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://databricks.com/blog/2016/05/18/spark-mllib-from-quick-start-to-scikit-learn.html</span></p> <p> </p> <p><span style="font-family:Helvetica;">Hortonworks</span><span style="font-family: 宋体;">博客回顾äº?/span><span style="font-family:Helvetica;">Apache Storm</span><span style="font-family:宋体;">的历双Ӏ?/span><span style="font-family:Helvetica;">2011</span><span style="font-family:宋体;">òq´å¼€æºï¼Œ</span><span style="font-family:Helvetica;">2013</span><span style="font-family:宋体;">òq´è¿›å…?/span><span style="font-family:Helvetica;">Apache</span><span style="font-family:宋体;">孵化器,</span><span style="font-family:Helvetica;">2014</span><span style="font-family:宋体;">òq´æˆä¸ºé¡¶¾U§é¡¹ç›®ï¼Œä»Šå¹´åˆå‘布了</span><span style="font-family:Helvetica;">1.0</span><span style="font-family:宋体;">版。本文论˜qîCº†æ¯ä¸ªé‡Œç¨‹¼„‘的主要技术进步ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://hortonworks.com/blog/brief-history-apache-storm/</span></p> <p> </p> <p align="left"><span style="font-family:Helvetica;">HBaseCon</span><span style="font-family:宋体;">本周在旧金山召开。这‹Æ¡ä¼šè®®ï¼Œ</span><span style="font-family:Helvetica;">Apple</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Yahoo</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Facebook</span><span style="font-family:宋体;">都有演讲材料ã€?/span></p> <p align="left"><a href="http://hbasecon.com/"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline: none">http://hbasecon.com</span></a></p> <p> </p> <p><span style="font-family:Helvetica;">MapR</span><span style="font-family:宋体;">发图庆祝了过åŽÖM¸€òq´ä¸­</span><span style="font-family: Helvetica;">Apache Drill</span><span style="font-family:宋体;">取得的成¾l©ã€‚一òq´ä¸­å‘布äº?/span><span style="font-family:Helvetica;">7</span><span style="font-family:宋体;">个版本,完成了多个里½E‹ç¢‘ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://www.mapr.com/blog/happy-anniversary-apache-drill-what-difference-year-makes</span></p> <p> </p> <p><span style="font-family:Helvetica;">Datanami</span><span style="font-family:宋体;">发布了在</span><span style="font-family:Helvetica;">Apache: Big Data North America</span><span style="font-family:宋体;">会议上,</span><span style="font-family:Helvetica;">ASF</span><span style="font-family:宋体;">æ€È›‘</span><span style="font-family:Helvetica;">Jim Jagielski</span><span style="font-family: 宋体;">å’?/span><span style="font-family:Helvetica;">ODPi</span><span style="font-family:宋体;">™å¹ç›®æ€È›‘</span><span style="font-family:Helvetica;">John Mertic</span><span style="font-family:宋体;">的问½{”录åQŒå¦‚大家所料,主要话题˜q˜æ˜¯</span><span style="font-family:Helvetica;">ASF</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">ODPi</span><span style="font-family:宋体;">的关¾p…R€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://www.datanami.com/2016/05/20/apache-foundation-keeps-eyes-wide-open-odpi/</span></p> <p> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">产品发布</span></strong><strong></strong></p> <p align="left"><span style="font-family:Helvetica;">LinkedIn</span><span style="font-family:宋体;">开源了</span><span style="font-family:Helvetica;">Ambry</span><span style="font-family:宋体;">åQŒä»–们的</span><span style="font-family:Helvetica;">ObjectStore</span><span style="font-family: 宋体;">分布式系¾lŸã€?/span><span style="font-family:Helvetica;">Ambry</span><span style="font-family:宋体;">代码已提交到</span><span style="font-family:Helvetica;">github</span><span style="font-family:宋体;">åQŒè¿™½‹‡åšæ–‡ä»‹¾läº†</span><span style="font-family:Helvetica;">Ambry</span><span style="font-family:宋体;">的服务承诺,设计目标åQŒä½“¾pÀLž¶æž„和接口ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">https://engineering.linkedin.com/blog/2016/05/introducing-and-open-sourcing-ambry---linkedins-new-distributed-</span></p> <p align="left"> </p> <p align="left"><span style="font-family:宋体;">ç”?/span><span style="font-family:Helvetica;">apache HAWQ</span><span style="font-family:宋体;">åQˆå­µåŒ–中åQ‰é©±åŠ¨çš„</span><span style="font-family:Helvetica;">Pivotal HDB </span><span style="font-family:宋体;">本周发布äº?/span><span style="font-family:Helvetica;">2.0</span><span style="font-family:宋体;">版,</span><span style="font-family:Helvetica;">HDB</span><span style="font-family:宋体;">ä¸?/span><span style="font-family:Helvetica;">Hadoop</span><span style="font-family:宋体;">提供了分析数据库ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">https://blog.pivotal.io/big-data-pivotal/products/fail-fast-and-ask-more-questions-of-your-data-with-hdb-2-0</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Apache Mahout</span><span style="font-family:宋体;">本周发布äº?/span><span style="font-family:Helvetica;">0.12.1</span><span style="font-family:"MS Mincho";MS Mincho";">版,</span><span style="font-family:Helvetica;">Mahout</span><span style="font-family:宋体;">是一个机器学习和数据挖掘¾pȝ»Ÿã€‚本‹Æ¡å‘布旨在推˜q?/span><span style="font-family:Helvetica;">Flink</span><span style="font-family:宋体;">ä¸?/span><span style="font-family:Helvetica;">Mahout</span><span style="font-family:宋体;">的集成ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://mail-archives.us.apache.org/mod_mbox/www-announce/201605.mbox/%3CCAOtpBjhshagyLN3Qnt0xRnc7YbnMVJjTS4piVXL7LiS2pQguXw@mail.gmail.com%3E</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Apache Tajo</span><span style="font-family:宋体;">发布äº?/span><span style="font-family:Helvetica;">0.11.3</span><span style="font-family:宋体;">版ã€?/span><span style="font-family:Helvetica;">Tajo</span><span style="font-family:宋体;">æ˜?/span><span style="font-family:Helvetica;">Hadoop</span><span style="font-family:宋体;">的数据仓库。本‹Æ¡å‘布修正了</span><span style="font-family:Helvetica;">5</span><span style="font-family:宋体;">ä¸?/span><span style="font-family:Helvetica;">bug</span><span style="font-family:宋体;">ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://tajo.apache.org/releases/0.11.3/announcement.html</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">MongoDB</span><span style="font-family:宋体;">ä¸?/span><span style="font-family:Helvetica;">Apache Spark</span><span style="font-family: 宋体;">发布了新çš?/span><span style="font-family:Helvetica;">MongoDB Connector</span><span style="font-family:宋体;">。除了对åº?/span><span style="font-family:Helvetica;">Spark</span><span style="font-family:宋体;">çš?/span><span style="font-family:Helvetica;">Hadoop InputFormat shim</span><span style="font-family:宋体;">外,è¯?/span><span style="font-family:Helvetica;">Connector</span><span style="font-family:宋体;">˜q˜æœ‰å…¶ä»–ç‰ÒŽ€§ã€‚最后,˜q˜è§£é‡Šäº†</span><span style="font-family: Helvetica;">MongoDB</span><span style="font-family:宋体;">一些关键特性ã€?/span></p> <p align="left"><a href="https://www.mongodb.com/blog/post/mongodb-connector-for-apache-spark-announcing-early-access-program-and-new-spark-training"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">https://www.mongodb.com/blog/post/mongodb-connector-for-apache-spark-announcing-early-access-program-and-new-spark-training</span></a></p> <p align="left"><a href="http://rosslawley.co.uk/introducing-a-new=mongodb-spark-connector/"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">http://rosslawley.co.uk/introducing-a-new=mongodb-spark-connector/</span></a></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">SyncSort</span><span style="font-family:宋体;">发布äº?/span><span style="font-family:Helvetica;">DMX-h v9</span><span style="font-family:宋体;">åQŒæ”¯æŒ?/span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">以及新的æ™ø™ƒ½æ‰§è¡Œæ¡†æž¶ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://insidebigdata.com/2016/05/20/syncsorts-latest-innovations-simplify-integration-of-streaming-data-in-spark-kafka-and-hadoop-for-real-time-analytics/</span></p> <p align="left"> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">‹zÕdŠ¨</span></strong><strong></strong></p> <p align="left"><span style="font-size:14.0pt;font-family:SimSun;">中国</span></p> <p align="left"><span style="font-family:SimSun;">æ—?/span></p><img src ="http://www.qpkxbc.shop/rosen/aggbug/430838.html" width = "1" height = "1" /><br><br><div align=right><a style="text-decoration:none;" href="http://www.qpkxbc.shop/rosen/" target="_blank">Rosen</a> 2016-06-08 16:42 <a href="http://www.qpkxbc.shop/rosen/archive/2016/06/08/430838.html#Feedback" target="_blank" style="text-decoration:none;">发表评论</a></div>]]></description></item><item><title>Hadoop周刊—第 169 æœ?/title><link>http://www.qpkxbc.shop/rosen/archive/2016/05/15/430513.html</link><dc:creator>Rosen</dc:creator><author>Rosen</author><pubDate>Sun, 15 May 2016 12:30:00 GMT</pubDate><guid>http://www.qpkxbc.shop/rosen/archive/2016/05/15/430513.html</guid><wfw:comment>http://www.qpkxbc.shop/rosen/comments/430513.html</wfw:comment><comments>http://www.qpkxbc.shop/rosen/archive/2016/05/15/430513.html#Feedback</comments><slash:comments>1</slash:comments><wfw:commentRss>http://www.qpkxbc.shop/rosen/comments/commentRss/430513.html</wfw:commentRss><trackback:ping>http://www.qpkxbc.shop/rosen/services/trackbacks/430513.html</trackback:ping><description><![CDATA[<p class="MsoNormal" align="left" style="text-align:left;line-height:10%; mso-outline-level:1"><strong style="mso-bidi-font-weight:normal"><span lang="EN-US" style="font-size:16.0pt;line-height:10%"><o:p> </o:p></span></strong></p><p align="left" style="line-height: 10%;"><br /></p><p align="left" style="line-height: 10%;"><strong><span style="font-size:16.0pt;line-height:10%">Hadoop</span></strong><strong><span style="font-size:16.0pt;line-height:10%;font-family:宋体;">周刊</span></strong><strong> </strong><strong><span style="font-size:16.0pt;line-height: 10%;font-family:宋体;">½W?/span></strong><strong><span style="font-size:16.0pt;line-height:10%"> 169 </span></strong><strong><span style="font-size:16.0pt;line-height: 10%;font-family:宋体;">æœ?/span></strong><strong></strong></p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">启明星辰òq›_°å’Œå¤§æ•°æ®æ•´ä½“¾l„ç¼–è¯?/span></p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"><span style="font-size:14.0pt;line-height:10%">2016</span><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">òq?/span><span style="font-size:14.0pt;line-height:10%">5</span><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">æœ?/span><span style="font-size:14.0pt;line-height:10%">8</span><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">æ—?/span></p> <p> </p> <p><span style="font-family:宋体;">本周内容短小¾_„¡»ƒã€‚主题覆ç›?/span><span style="font-family:Helvetica;">Apache Beam</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">MapR</span><span style="font-family:宋体;">季度业ç‡W、最˜q‘çš„</span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">å³îC¼šåQŒä»¥åŠæ¥è‡?/span><span style="font-family:Helvetica;">Cloudera</span><span style="font-family:宋体;">新开源的分布式单元测试框架ã€?/span></p> <p> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">技术新é—?/span></strong><strong></strong></p> <p><span style="font-family:Helvetica;">Elastic</span><span style="font-family:宋体;">分析了宕æœÞZº‹ä»¶çš„æ ÒŽºã€‚错误配¾|?/span><span style="font-family: Helvetica;">ZooKeeper</span><span style="font-family:宋体;">内存讄¡½®ä¼šå¼•èµ¯‚¿‡åº¦çš„</span><span style="font-family:Helvetica;">GC</span><span style="font-family:宋体;">åQŒè¿™ž®†ä»Žæ ÒŽœ¬ä¸Šå¯¼è‡?/span><span style="font-family:Helvetica;">ZooKeeper</span><span style="font-family:宋体;">集群丢失。文章介¾läº†ä¸€äº›ç¼“解策略,用来防止未来¾cÖM¼¼é—®é¢˜çš„发生ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://www.elastic.co/blog/elastic-cloud-outage-april-2016</span></p> <p> </p> <p><span style="font-family:Helvetica;">Cask</span><span style="font-family:宋体;">博客½Ž€æ˜Žæ‰¼è¦çš„归纳了最˜q?/span><span style="font-family: Helvetica;">Big Data Applications Meetup</span><span style="font-family:宋体;">的花¾i®ã€‚首先出场的æ˜?/span><span style="font-family:Helvetica;">Pachyderm</span><span style="font-family:宋体;">åQŒå®ƒåŸÞZºŽ</span><span style="font-family:Helvetica;">Docker</span><span style="font-family:宋体;">容器提供</span><span style="font-family:Helvetica;">“</span><span style="font-family:宋体;">数据</span><span style="font-family:Helvetica;">Git”</span><span style="font-family:宋体;">语义。第二个出场的是</span><span style="font-family: Helvetica;">TubeMogul</span><span style="font-family:宋体;">大数据åã^収ͼŒ</span><span style="font-family:Helvetica;">TubeMogul</span><span style="font-family:宋体;">构徏äº?/span><span style="font-family:Helvetica;">Hadoop</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Hive</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Spark</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Presto</span><span style="font-family:宋体;">之上ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://blog.cask.co/2016/05/pachyderm-and-tubemogul-share-their-big-data-application-platforms-and-experience/</span></p> <p> </p> <p><span style="font-family:Helvetica;">Google</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">dataArtisans</span><span style="font-family:宋体;">同时撰文介绍äº?/span><span style="font-family:Helvetica;">Apache Beam</span><span style="font-family:宋体;">åQˆå‰ç”Ÿæ˜¯</span><span style="font-family:Helvetica;">Google Dataflow SDK</span><span style="font-family:宋体;">åQ‰ã€?/span><span style="font-family:Helvetica;">Google</span><span style="font-family:宋体;">的文章解释了ä¸ÞZ½•å¼€æºå’Œå¼€å?/span><span style="font-family:Helvetica;">Beam</span><span style="font-family:宋体;">的动机,</span><span style="font-family:Helvetica;">dataArtisans</span><span style="font-family: 宋体;">的文章介¾lä»–们对</span><span style="font-family:Helvetica;">Beam</span><span style="font-family:宋体;">模型的支持以及怎样考虑</span><span style="font-family:Helvetica;">Flink</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">Beam API</span><span style="font-family:宋体;">之间的关¾p…R€?/span></p> <p align="left"><a href="https://cloud.google.com/blog/big-data/2016/05/why-apache-beam-a-google-perspective"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">https://cloud.google.com/blog/big-data/2016/05/why-apache-beam-a-google-perspective</span></a></p> <p><a href="http://data-artisans.com/why-apache-beam/"><span style="font-family:Helvetica;color:#386EFF;text-decoration: none;text-underline:none">http://data-artisans.com/why-apache-beam/</span></a></p> <p> </p> <p><span style="font-family:Helvetica;">IBM Hadoop dev</span><span style="font-family: 宋体;">博客有个关于安装</span><span style="font-family:Helvetica;">Python</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Scala</span><span style="font-family:宋体;">和äؓ</span><span style="font-family:Helvetica;">Jupyter notebook</span><span style="font-family:宋体;">嵌入</span><span style="font-family:Helvetica;">R</span><span style="font-family:宋体;">内核的操作说明。同æ—Óž¼Œä¹Ÿè¯´æ˜Žäº†æ€Žæ ·˜qžæŽ¥</span><span style="font-family:Helvetica;">Spark</span><span style="font-family:宋体;">和通过</span><span style="font-family:Helvetica;">SSL</span><span style="font-family:宋体;">暴露</span><span style="font-family:Helvetica;">notebook</span><span style="font-family:宋体;">ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://developer.ibm.com/hadoop/blog/2016/05/04/install-jupyter-notebook-spark/</span></p> <p> </p> <p><span style="font-family:宋体;">本文介绍äº?/span><span style="font-family:Helvetica;">Mongo Hadoop</span><span style="font-family:宋体;">的连接函数是如何½Hœè“v</span><span style="font-family: Helvetica;">Spark</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">MongoDB</span><span style="font-family:宋体;">的ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://x.ai/using-the-mongo-hadoop-connector-as-a-translation-layer-to-spark/</span></p> <p> </p> <p><span style="font-family:Helvetica;">Qubole</span><span style="font-family:宋体;">博客撰文比较了用于大数据分析的流行编½E‹è¯­­a€</span><span style="font-family:Helvetica;">—Python</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">R</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">Scala</span><span style="font-family:宋体;">ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://www.qubole.com/blog/big-data/programming-language/</span></p> <p> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">其他新闻</span></strong><strong></strong></p> <p><span style="font-family:Helvetica;">MapR</span><span style="font-family:宋体;">宣布本季度他们授权下单创¾Uªå½•çš„增长了</span><span style="font-family:Helvetica;">99%</span><span style="font-family:宋体;">åQŒä»¥å?/span><span style="font-family:Helvetica;">146%</span><span style="font-family:宋体;">的美元净增长率ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://www.mapr.com/company/press-releases/mapr-achieves-another-record-quarter-99-software-subscription-license-growth</span></p> <p> </p> <p><span style="font-family:宋体;">本文描述了最˜q?/span><span style="font-family:Helvetica;">Google Cloud Dataflow</span><span style="font-family: 宋体;">å’?/span><span style="font-family:Helvetica;">Apache Spark</span><span style="font-family:宋体;">åœ?/span><span style="font-family:Helvetica;">Google Compute Engine</span><span style="font-family:宋体;">上的基准‹¹‹è¯•è¡¨çŽ°ã€?/span><span style="font-family:Helvetica;">Dataflow</span><span style="font-family:宋体;">胜过</span><span style="font-family:Helvetica;">Spark2</span><span style="font-family:宋体;">åQ?/span><span style="font-family:Helvetica;">5.7</span><span style="font-family:宋体;">倍(一直以来,最好是在自å·Þqš„环境下评估工作负载,而不是一味的信ä“Q基准‹¹‹è¯•åQ‰ã€‚本文还解释了一¿U?/span><span style="font-family:Helvetica;">“</span><span style="font-family:宋体;">å†ähˆ˜</span><span style="font-family:Helvetica;">”</span><span style="font-family:宋体;">åQŒé€šè¿‡å®ƒä‹É每个使用大数据工å…ïLš„äºø™Ž·ç›Šã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://www.datanami.com/2016/05/02/dataflow-tops-spark-benchmark-test/</span></p> <p> </p> <p><span style="font-family:Helvetica;">Confluent</span><span style="font-family:宋体;">博客回顾了最˜q‘召开çš?/span><span style="font-family: Helvetica;">Kafka</span><span style="font-family:宋体;">å³îC¼šåQŒåŒ…括编½E‹æŒ‘战预选赛åQŒä¸»é¢˜æ¼”è®ÔŒ¼Œåˆ†ç»„会议½{‰ç­‰ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://www.confluent.io/blog/log-compaction-kafka-summit-edition-may-2016</span></p> <p> </p> <p><span style="font-family:宋体;">¼›å¸ƒæ–¯ä»‹¾läº†¾ŸŽå›½˜qé€šåœ¨˜q‡åŽ»</span><span style="font-family:Helvetica;">5</span><span style="font-family:宋体;">òq´é—´é‡‡ç”¨å¤§æ•°æ®æŠ€æœ¯çš„历程。本文中åQŒç¾Žå›½è¿é€šåˆ†äº«äº†ä¸€äº›æŠ€å·§å’Œå­¦åˆ°çš„经验教训,例如采用新技术的困难åQˆå¾—到组¾l‡é«˜å±‚的认同是多么的重要åQ‰ï¼Œä»¥åŠé›‡ä„¦å’Œç•™ä½å·¥½E‹å¸ˆçš„挑战等½{‰ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://www.forbes.com/sites/ciocentral/2016/04/27/inside-american-express-big-data-journey/</span></p> <p> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">产品发布</span></strong><strong></strong></p> <p align="left"><span style="font-family:Helvetica;">Cask</span><span style="font-family:宋体;">发布äº?/span><span style="font-family:Helvetica;">Cask Data Application Platform (CDAP)3.4</span><span style="font-family:宋体;">版本ã€?/span><span style="font-family:"MS Mincho";MS Mincho";">新版本增加了</span><span style="font-family:Helvetica;">Cask Tracker</span><span style="font-family: 宋体;">åQŒæ–°çš„数据集æˆ?/span><span style="font-family:Helvetica;">/</span><span style="font-family:宋体;">审计</span><span style="font-family:Helvetica;">/</span><span style="font-family:宋体;">搜烦¾pȝ»ŸåQŒå‡¾U§äº†</span><span style="font-family:Helvetica;">Cask Hydrator</span><span style="font-family:宋体;">çš?/span><span style="font-family:Helvetica;">UI</span><span style="font-family:宋体;">åQŒå¢žå¼ÞZº†å¯?/span><span style="font-family:Helvetica;">Spark</span><span style="font-family:宋体;">的支持等½{‰ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://blog.cask.co/2016/05/announcing-cdap-release-3-4-introducing-tracker-next-gen-hydrator-enhanced-spark-support-and-much-more/</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Cloudera</span><span style="font-family:宋体;">开源了</span><span style="font-family:Helvetica;">“dist_tes”</span><span style="font-family:宋体;">åQŒåƈ行执行单元测试的新工兗÷€‚通过该工å…øP¼Œå¯?/span><span style="font-family:Helvetica;">Hadoop</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">Kudu</span><span style="font-family:宋体;">™å¹ç›®˜q›è¡Œå•å…ƒ‹¹‹è¯•åQŒå¯ä»¥åœ¨æ•°åˆ†é’Ÿè€Œä¸æ˜¯æ•°ž®æ—¶å†…完成。该工具¾l‘定äº?/span><span style="font-family: Helvetica;">C++</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">Java</span><span style="font-family:宋体;">åQŒåƈ在网站上演示了这些特性ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://blog.cloudera.com/blog/2016/05/quality-assurance-at-cloudera-distributed-unit-testing/</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Google</span><span style="font-family:宋体;">宣布</span><span style="font-family:Helvetica;">Google BigQuery</span><span style="font-family: 宋体;">å’?/span><span style="font-family:Helvetica;">Drive</span><span style="font-family:宋体;">可集成在一èµøP¼ŒæŠŠè¾“å‡ÞZ¿å­˜åˆ°</span><span style="font-family:Helvetica;">Google sheets</span><span style="font-family:宋体;">ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://techcrunch.com/2016/05/06/google-connects-bigquery-to-google-drive-and-sheets/</span></p> <p align="left"> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">‹zÕdŠ¨</span></strong><strong></strong></p> <p align="left"><span style="font-size:14.0pt;font-family:SimSun;">中国</span></p> <p align="left"><span style="font-family:SimSun;">æ—?/span></p><img src ="http://www.qpkxbc.shop/rosen/aggbug/430513.html" width = "1" height = "1" /><br><br><div align=right><a style="text-decoration:none;" href="http://www.qpkxbc.shop/rosen/" target="_blank">Rosen</a> 2016-05-15 20:30 <a href="http://www.qpkxbc.shop/rosen/archive/2016/05/15/430513.html#Feedback" target="_blank" style="text-decoration:none;">发表评论</a></div>]]></description></item><item><title>Hadoop周刊—第 168 æœ?/title><link>http://www.qpkxbc.shop/rosen/archive/2016/05/07/430401.html</link><dc:creator>Rosen</dc:creator><author>Rosen</author><pubDate>Sat, 07 May 2016 15:37:00 GMT</pubDate><guid>http://www.qpkxbc.shop/rosen/archive/2016/05/07/430401.html</guid><wfw:comment>http://www.qpkxbc.shop/rosen/comments/430401.html</wfw:comment><comments>http://www.qpkxbc.shop/rosen/archive/2016/05/07/430401.html#Feedback</comments><slash:comments>0</slash:comments><wfw:commentRss>http://www.qpkxbc.shop/rosen/comments/commentRss/430401.html</wfw:commentRss><trackback:ping>http://www.qpkxbc.shop/rosen/services/trackbacks/430401.html</trackback:ping><description><![CDATA[<p align="left" style="line-height: 10%;"><strong> </strong></p> <p align="left" style="line-height: 10%;"><strong><span style="font-size:16.0pt;line-height:10%">Hadoop</span></strong><strong><span style="font-size:16.0pt;line-height:10%;font-family:宋体;">周刊</span></strong><strong> </strong><strong><span style="font-size:16.0pt;line-height: 10%;font-family:宋体;">½W?/span></strong><strong><span style="font-size:16.0pt;line-height:10%"> 168 </span></strong><strong><span style="font-size:16.0pt;line-height: 10%;font-family:宋体;">æœ?/span></strong><strong></strong></p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">启明星辰òq›_°å’Œå¤§æ•°æ®æ•´ä½“¾l„ç¼–è¯?/span></p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"> </p> <p align="left" style="line-height: 10%;"><span style="font-size:14.0pt;line-height:10%">2016</span><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">òq?/span><span style="font-size:14.0pt;line-height:10%">5</span><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">æœ?/span><span style="font-size:14.0pt;line-height:10%">1</span><span style="font-size:14.0pt;line-height:10%;font-family:宋体;">æ—?/span></p> <p> </p> <p><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">å³îC¼šæœ¬å‘¨åœ¨æ—§é‡‘山召开åQŒä¸å®¹ç½®ç–‘本周期刊将有大量的</span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">内容。除此以外,˜q˜æœ‰å¤§é‡å…³äºŽ</span><span style="font-family:Helvetica;">Impala</span><span style="font-family:宋体;">性能ã€?/span><span style="font-family:Helvetica;">Kudu</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Druid</span><span style="font-family:宋体;">斚w¢çš„文章。在其他新闻部分åQ?/span><span style="font-family:Helvetica;">Apache Apex</span><span style="font-family:宋体;">成äؓäº?/span><span style="font-family:Helvetica;">Apache</span><span style="font-family:宋体;">的顶¾U§é¡¹ç›®ï¼Œ</span><span style="font-family:Helvetica;">Qubole</span><span style="font-family:宋体;">开源了å…?/span><span style="font-family:Helvetica;">StreamX</span><span style="font-family:宋体;">™å¹ç›®ã€?/span></p> <p> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">技术新é—?/span></strong><strong></strong></p> <p><span style="font-family: 宋体;">本文快速浏览了如何在可能或不可能创建新数据分区的情况下操作</span><span style="font-family:Helvetica;">Spark RDD</span><span style="font-family:宋体;">。尤å…?/span><span style="font-family:Helvetica;">`mapValues`</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">`filter`</span><span style="font-family:宋体;">会保存分åŒø™€?/span><span style="font-family:Helvetica;">`map`</span><span style="font-family:宋体;">却不会ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://medium.com/@corentinanjuna/apache-spark-rdd-partitioning-preservation-2187a93bc33e</span></p> <p><span style="position: relative;z-index:251659264"><span style="left:0px;position:absolute;left:-10px; top:-133px;width:433px;height:19px"><img width="433" height="19" src="file://localhost/Users/jiangrongsheng/Library/Group%20Containers/UBF8T346G9.Office/msoclip1/01/clip_image001.png" v:shapes="直线˜qžæŽ¥½W¦_x0020_1" alt="" /></span></span> </p> <br clear="ALL" /> <p><span style="font-family:宋体;">本文介绍了如何ä‹Éç”?/span><span style="font-family:Helvetica;">Conda</span><span style="font-family:宋体;">构徏独立çš?/span><span style="font-family:Helvetica;">Python</span><span style="font-family:宋体;">环境åQˆä¾‹å¦?/span><span style="font-family:Helvetica;">pandas</span><span style="font-family:宋体;">插äšgåQ‰ï¼Œä»¥ä¾¿åšäؓ</span><span style="font-family:Helvetica;">Spark job</span><span style="font-family:宋体;">的一部分装蝲到集¾Ÿ¤èŠ‚炏V€‚经˜q‡è¿™æ ïLš„处理åQŒå°±èƒ½åœ¨æ²¡æœ‰</span><span style="font-family:Helvetica;">python</span><span style="font-family:宋体;">原生包被安装在主操作¾pȝ»Ÿä¸Šçš„情况下运è¡?/span><span style="font-family:Helvetica;">PySpark job</span><span style="font-family:宋体;">。这¿Uæ–¹æ¡ˆåŒæ ·é€‚用äº?/span><span style="font-family:Helvetica;">SparkR</span><span style="font-family:宋体;">ã€?/span></p> <p align="left"><a href="http://quasiben.github.io/blog/2016/4/15/conda-spark/"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">http://quasiben.github.io/blog/2016/4/15/conda-spark/</span></a></p> <p> </p> <p><span style="font-family:Helvetica;">Datadog</span><span style="font-family:宋体;">博客有三½‹‡ç›‘æŽ?/span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">的系列文章。第一½‹‡è¯¦¾l†æ¦‚括了</span><span style="font-family:Helvetica;">broker</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">producer</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">consumers</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">ZooKeeper</span><span style="font-family:宋体;">的关键度量指标。第二篇介绍了怎样åœ?/span><span style="font-family:Helvetica;">JConsole</span><span style="font-family:宋体;">和其他工具上通过</span><span style="font-family:Helvetica;">JMX</span><span style="font-family:宋体;">查看指标åQŒç¬¬ä¸‰ç¯‡ä»‹ç»äº?/span><span style="font-family: Helvetica;">Datadog</span><span style="font-family:宋体;">集成斚w¢çš„知识ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://www.datadoghq.com/blog/monitoring-kafka-performance-metrics/</span></p> <p> </p> <p><span style="font-family:Helvetica;">Salesforce</span><span style="font-family:宋体;">撰文介绍äº?/span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">在他们组¾l‡å†…的成长史。最初,他们借助</span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">驱动了操作指标分析功能,渐渐地成ä¸ÞZ¸€ä¸ªé©±åŠ¨ä¼—多系¾lŸçš„大åã^台ã€?/span><span style="font-family: Helvetica;">Salesforce</span><span style="font-family:宋体;">˜qç”¨</span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">在多个数据中心运行,òq¶ä‹Éç”?/span><span style="font-family:Helvetica;">MirrorMaker</span><span style="font-family:宋体;">在集¾Ÿ¤é—´å¤åˆ¶å’Œèšåˆæ•°æ®ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://medium.com/salesforce-engineering/expanding-visibility-with-apache-kafka-e305b12c4aba#.5k7j921o3</span></p> <p> </p> <p><span style="font-family:Helvetica;">Metamarkets</span><span style="font-family: 宋体;">博客有一½‹‡å…³äºŽä¼˜åŒ–大规模分布式系¾lŸçš„有趣博文ã€?/span><span style="font-family:Helvetica;">Druid</span><span style="font-family:宋体;">åQŒä»–们的分布式数据仓库,最˜q‘增加了一¿U?/span><span style="font-family:Helvetica;">"</span><span style="font-family:宋体;">先进先出</span><span style="font-family:Helvetica;">"</span><span style="font-family:宋体;">的查询模式,òq¶åœ¨é‡åž‹è´Ÿè²å¤§é›†¾Ÿ¤é—´˜q›è¡Œäº†æµ‹è¯•ã€‚根据他们的假设åQŒæŽ¨‹¹‹ä“Q何可能发生和攉™›†åˆ°æœ‰­‘£çš„的指标ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://metamarkets.com/2016/impact-on-query-speed-from-forced-processing-ordering-in-druid/</span></p> <p> </p> <p><span style="font-family:Helvetica;">Google Cloud Big Data</span><span style="font-family:宋体;">博客撰文介绍äº?/span><span style="font-family:Helvetica;">BigQuery</span><span style="font-family:宋体;">的内部存储格式,容器åQŒä»¥åŠå…¶å®ƒä‹É得存储数据更有效率的优化措施ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://cloud.google.com/blog/big-data/2016/04/inside-capacitor-bigquerys-next-generation-columnar-storage-format</span></p> <p> </p> <p><span style="font-family:Helvetica;">Apache Kudu</span><span style="font-family: 宋体;">åQˆå­µåŒ–中åQ‰åšå®¢æ¦‚˜qîCº†æœ€˜q‘ä‹Éç”?/span><span style="font-family: Helvetica;">YCSB</span><span style="font-family:宋体;">工具对系¾lŸæ€§èƒ½åˆ†æžå’Œè°ƒä¼˜çš„¾l“æžœã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://getkudu.io/2016/04/26/ycsb.html</span></p> <p> </p> <p><span style="font-family:Helvetica;">Impala 2.5</span><span style="font-family:宋体;">无论æ˜?/span><span style="font-family:Helvetica;">TPC</span><span style="font-family:宋体;">基准‹¹‹è¯•˜q˜æ˜¯å…¶å®ƒæ–šw¢å‡æœ‰æ˜¾è‘—的性能提升。提升项包括˜qè¡Œæ—¶è¿‡æ»¤å™¨åQ?/span><span style="font-family:Helvetica;">LLVM</span><span style="font-family:宋体;">代码生成器对</span><span style="font-family:Helvetica;">`SORT`</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">`DECIMAL`</span><span style="font-family:宋体;">的支持,更快çš?/span><span style="font-family:Helvetica;">metadata-only</span><span style="font-family:宋体;">查询åQŒç­‰½{‰ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://blog.cloudera.com/blog/2016/04/apache-impala-incubating-in-cdh-5-7-4x-faster-for-bi-workloads-on-apache-hadoop/</span></p> <p> </p> <p><span style="font-family:宋体;">本文介绍了,为支持高可用性,如何å¯?/span><span style="font-family:Helvetica;">Hive Metastore</span><span style="font-family:宋体;">配置</span><span style="font-family:Helvetica;">MariaDB</span><span style="font-family:宋体;">的ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://developer.ibm.com/hadoop/blog/2016/04/26/bigsql-ha-configure-ha-hive-metastore-db-using-mariadb10-1/</span></p> <p> </p> <p><span style="font-family:Helvetica;">Altiscale</span><span style="font-family:宋体;">博客撰文介绍了寻æ‰?/span><span style="font-family:Helvetica;">NodeGroup</span><span style="font-family:宋体;">相关</span><span style="font-family:Helvetica;">bug</span><span style="font-family:宋体;">的过½E‹ï¼ˆè·Ÿè¿›ä¸‰æœˆçš„文章)。如果你因没扑ֈ°</span><span style="font-family:Helvetica;">Hadoop</span><span style="font-family:宋体;">åQˆæˆ–其他分布式系¾lŸï¼‰çš?/span><span style="font-family:Helvetica;">bug</span><span style="font-family:宋体;">根结而气馁,不要åÒŽ°”。本文告诉你˜q™çš„¼‹®å›°éš¾ï¼Œç”šè‡³éœ€è¦ç¨‹åºå‘˜åœ¨é”€å”?/span><span style="font-family:Helvetica;">Hadoop</span><span style="font-family:宋体;">服务的企业干‹zÀL‰èƒ½æžå®šã€?/span></p> <p align="left"><a href="https://www.altiscale.com/blog/part-1-2-investigation-analysis-and-resolution-of-nodegroup-performance-issues-on-bare-metal-hardware-clusters/"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">https://www.altiscale.com/blog/part-1-2-investigation-analysis-and-resolution-of-nodegroup-performance-issues-on-bare-metal-hardware-clusters/</span></a></p> <p> </p> <p><span style="font-family:Helvetica;">Netflix</span><span style="font-family:宋体;">现在˜qè¡Œäº†è¶…˜q?/span><span style="font-family:Helvetica;">4000</span><span style="font-family:宋体;">ä¸?/span><span style="font-family:Helvetica;">Kafka </span><span style="font-family:Helvetica;">broker</span><span style="font-family:宋体;">åQŒæ¨ªè·?/span><span style="font-family:Helvetica;">36</span><span style="font-family:宋体;">个集¾Ÿ¤ã€‚在云中˜qè¡Œ</span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">需要一些权衡,团队òqŒ™¡¡äº†å¼€é”€å’Œæ•°æ®ä¸¢å¤±ï¼ˆæ—¥æ•°æ®ä¸¢å¤±å°äº?/span><span style="font-family:Helvetica;">0.01%</span><span style="font-family:宋体;">åQ‰ã€‚本文分享了团队åœ?/span><span style="font-family:Helvetica;">AWS</span><span style="font-family:宋体;">中运è¡?/span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">的经验,主要是一些典型问题,部çÖv½{–ç•¥åQˆå°é›†ç¾¤ã€éš”¼›Èš„</span><span style="font-family:Helvetica;">zookeeper</span><span style="font-family:宋体;">集群åQ‰ï¼Œé›†ç¾¤¾U§å®¹é”™ï¼Œæ”¯æŒ</span><span style="font-family:Helvetica;">AWS availability zones</span><span style="font-family: 宋体;">åQ?/span><span style="font-family:Helvetica;">Kafka UI</span><span style="font-family:宋体;">可视化等½{‰ã€?/span></p> <p align="left"><a href="http://techblog.netflix.com/2016/04/kafka-inside-keystone-pipeline.html"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">http://techblog.netflix.com/2016/04/kafka-inside-keystone-pipeline.html</span></a></p> <p align="left"> </p> <p><span style="font-family:Helvetica;">Amazon</span><span style="font-family:宋体;">大数据博客撰文介¾läº†å¦‚何ä»?/span><span style="font-family: Helvetica;">Amazon EMR</span><span style="font-family:宋体;">加密数据存放åœ?/span><span style="font-family:Helvetica;">S3</span><span style="font-family:宋体;">中。这¿Ué›†æˆæ–¹å¼åŒæ—¶æ”¯æŒå®¢æˆïL«¯å’ŒæœåŠ¡å™¨ç«¯åŠ å¯†ï¼ˆå€ŸåŠ©äº?/span><span style="font-family:Helvetica;">Amazon KMS</span><span style="font-family:宋体;">åQ‰ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">http://blogs.aws.amazon.com/bigdata/post/TxBQTAF 3X7VLEP/Process-Encrypted-Data-in-Amazon-EMR-with-Amazon-S3-and-AWS-KMS</span></p> <p> </p> <p><span style="font-family:Helvetica;">TubeMogul</span><span style="font-family:宋体;">介绍了他们大数据òq›_°çš„历åÔŒ¼Œè¯¥åã^台每月支撑万亿次数据分析è¯äh±‚。该团队很早ž®Þp¿ç”?/span><span style="font-family:Helvetica;">Amazon EMR</span><span style="font-family:宋体;">åQŒå¯¼å…¥äº†</span><span style="font-family:Helvetica;">Storm</span><span style="font-family:宋体;">实时处理技术,最¾lˆæŠŠå¤§æ•°æ®æœåŠ¡è½åœ¨äº†</span><span style="font-family:Helvetica;">Qubole</span><span style="font-family:宋体;">上ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://www.tubemogul.com/engineering/the-big-data-lifecycle-at-tubemogul/</span></p> <p> </p> <p><span style="font-family:Helvetica;">Caffe</span><span style="font-family:宋体;">åQŒæ·±åº¦å­¦ä¹ æ¡†æžÓž¼Œä¸?/span><span style="font-family:Helvetica;">Spark</span><span style="font-family:宋体;">˜q›è¡Œäº†é›†æˆ?/span><span style="font-family:Helvetica;">—CaffeOnSpark</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">MapR</span><span style="font-family:宋体;">公司撰文介绍了如何在</span><span style="font-family:Helvetica;">MapR YARN</span><span style="font-family:宋体;">上运行,文章˜q˜åŒ…括了采用的性能优化手段ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://www.mapr.com/blog/distributed-deep-learning-caffe-using-mapr-cluster</span></p> <p> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">其他新闻</span></strong><strong></strong></p> <p><span style="font-family:Helvetica;">Apache Apex</span><span style="font-family: 宋体;">åQŒå¤§æ•°æ®‹¹å¼å¤„理和批处理¾pȝ»ŸåQŒçŽ°åœ¨æˆä¸ÞZº†</span><span style="font-family:Helvetica;">Apache</span><span style="font-family:宋体;">软äšg基金会的™å¶çñ”™å¹ç›®ã€?/span><span style="font-family:Helvetica;">Apex</span><span style="font-family:宋体;">åŽÕd¹´</span><span style="font-family:Helvetica;">8</span><span style="font-family:宋体;">月进入孵化器ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://blogs.apache.org/foundation/entry/the_apache_ software_foundation_announces90</span></p> <p> </p> <p><span style="font-family:Helvetica;">Heroku Kafka</span><span style="font-family: 宋体;">åQŒæ˜¯ä¸€ä¸ªåˆ†æ”¯äºŽ</span><span style="font-family:Helvetica;">Heroku</span><span style="font-family:宋体;">çš?/span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">½Ž¡ç†æœåŠ¡ã€‚最˜q‘接˜q‘发å¸?/span><span style="font-family:Helvetica;">beta</span><span style="font-family:宋体;">版ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://blog.heroku.com/archives/2016/4/26/announcing-heroku-kafka-early-access</span></p> <p> </p> <p><span style="font-family:Helvetica;">MapR</span><span style="font-family:宋体;">博客上的一½‹‡æ–‡ç« å¼ºè°ƒäؓ什么性别多样性是重要的,˜q˜æåˆîCº†å¤§æ•°æ®è®ºå›ä¸­çš„女性,本文旨在鼓励å¥Ïx€§æŠ•íw«äºŽ˜q™ä¸€é¢†åŸŸã€?/span><span style="font-family:Helvetica;">“</span><span style="font-family:宋体;">大数据论坛中的女æ€?/span><span style="font-family:Helvetica;">”</span><span style="font-family:宋体;">研讨会本周由</span><span style="font-family:Helvetica;">MapR</span><span style="font-family:宋体;">¾l„织在圣何塞召开ã€?/span></p> <p><span style="font-family:Helvetica;color:#386EFF;">https://www.mapr.com/blog/case-women-big-data</span></p> <p> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">产品发布</span></strong><strong></strong></p> <p align="left"><span style="font-family:Helvetica;">StreamX</span><span style="font-family:宋体;">是一个来è‡?/span><span style="font-family:Helvetica;">Qubole</span><span style="font-family:宋体;">的开源项目,它能ä»?/span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">拯‚´æ•°æ®åˆ?/span><span style="font-family:Helvetica;">Amazon S3</span><span style="font-family:宋体;">˜q™æ ·çš„目标存储中ã€?/span><span style="font-family:Helvetica;">Qubole</span><span style="font-family:宋体;">æŠ?/span><span style="font-family:Helvetica;">StreamX</span><span style="font-family:宋体;">作äؓ一¿Uç®¡ç†æœåŠ¡æä¾›ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://www.qubole.com/blog/big-data/streamx/</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">SnappyData</span><span style="font-family:宋体;">是一个äؓ</span><span style="font-family:Helvetica;">OLAP</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">OLTP</span><span style="font-family:宋体;">查询‹¹å¼æ•°æ®çš„æ–°òq›_°åQˆå’Œå…¬å¸åQ‰ã€?/span><span style="font-family:Helvetica;">SnappyData</span><span style="font-family:宋体;">ç”?/span><span style="font-family:Helvetica;">Apache Spark</span><span style="font-family: 宋体;">å’?/span><span style="font-family:Helvetica;">GemFire</span><span style="font-family:宋体;">的内存存储技术驱动ã€?/span></p> <p align="left"><a href="http://www.infoworld.com/article/3062022/sql/apache-spark-powers-live-sql-analytics-in-snappydata.html"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">http://www.infoworld.com/article/3062022/sql/apache-spark-powers-live-sql-analytics-in-snappydata.html</span></a></p> <p align="left"><a href="http://www.snappydata.io/"><span style="font-family:Helvetica;color:#386EFF;text-decoration: none;text-underline:none">http://www.snappydata.io/</span></a></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Apache Geode</span><span style="font-family:宋体;">åQˆå­µåŒ–中åQ‰å‘布了</span><span style="font-family:Helvetica;">1.0.0-incubating.M2</span><span style="font-family:宋体;">版本åQŒå®ƒæ˜¯ä¸€ä¸ªåˆ†å¸ƒå¼æ•°æ®òq›_°åQŒçž„准高性能和低延迟。新版本提供了广域网下的点对点连接等新特性ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://mail-archives.apache.org/mod_mbox/incubator-geode-dev/201604.mbox/%3CCAFh%2B7k2eiK2TMGK sLqrY9CZDjxjYwiuTQ4QGUVC2s3geyJYwnA% 40mail.gmail.com%3E</span></p> <p align="left"> </p> <p align="left"><span style="font-family:Helvetica;">Apache Knox</span><span style="font-family:宋体;">发布äº?/span><span style="font-family:Helvetica;">0.9.0</span><span style="font-family:宋体;">版,它是</span><span style="font-family:Helvetica;">Hadoop</span><span style="font-family:宋体;">çš?/span><span style="font-family:Helvetica;">REST API</span><span style="font-family:宋体;">¾|‘关。新版本ä¸?/span><span style="font-family:Helvetica;">Ranger</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">Ambari</span><span style="font-family:宋体;">提供äº?/span><span style="font-family:Helvetica;">UI</span><span style="font-family:宋体;">界面支持åQŒä»¥åŠä¸€äº›å…¶å®ƒçš„提升å’?/span><span style="font-family:Helvetica;">bug</span><span style="font-family:宋体;">修复ã€?/span></p> <p align="left"><span style="font-family:Helvetica; color:#386EFF;">http://mail-archives.us.apache.org/mod_mbox/www-announce/201604.mbox/%3CCACRbFyjRF7zShb-NQ29d3FJ0hKZ57ts0Qfo31ffuNODpskwqPQ @mail.gmail.com%3E</span></p> <p align="left"> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">‹zÕdŠ¨</span></strong><strong></strong></p> <p align="left"><span style="font-size:14.0pt;font-family:SimSun;">中国</span></p> <p align="left"><span style="font-family:SimSun;">æ—?/span></p><img src ="http://www.qpkxbc.shop/rosen/aggbug/430401.html" width = "1" height = "1" /><br><br><div align=right><a style="text-decoration:none;" href="http://www.qpkxbc.shop/rosen/" target="_blank">Rosen</a> 2016-05-07 23:37 <a href="http://www.qpkxbc.shop/rosen/archive/2016/05/07/430401.html#Feedback" target="_blank" style="text-decoration:none;">发表评论</a></div>]]></description></item><item><title>Hadoop周刊—第 167 æœ?http://www.qpkxbc.shop/rosen/archive/2016/05/03/430325.htmlRosenRosenTue, 03 May 2016 02:08:00 GMThttp://www.qpkxbc.shop/rosen/archive/2016/05/03/430325.htmlhttp://www.qpkxbc.shop/rosen/comments/430325.htmlhttp://www.qpkxbc.shop/rosen/archive/2016/05/03/430325.html#Feedback0http://www.qpkxbc.shop/rosen/comments/commentRss/430325.htmlhttp://www.qpkxbc.shop/rosen/services/trackbacks/430325.htmlHadoop周刊 ½W?/span> 167 æœ?br />



启明星辰òq›_°å’Œå¤§æ•°æ®æ•´ä½“¾l„ç¼–è¯?/span>



2016
òq?/span>4æœ?/span>25æ—?/span>

 

‹Æ¢è¿Žæ¥åˆ°Hadoop周刊周一特别版。本周有大量来自Sparkã€?/span>Kafkaã€?/span>Beamã€?/span>Kudu的技术新闅R€‚如果你正在å¯ÀL‰¾ä¸€äº›æ›´å‰æ²¿çš„技术,Apache MetronåQˆå­µåŒ–中åQ‰å‘布了它们½W¬ä¸€ä¸ªç‰ˆæœ¬ã€?/span>MetronåQŒæ˜¯ä¸€ä¸ªæž„建在Hadoop上正在不断发展的通用安全¾pȝ»Ÿã€?/span>

 

技术新é—?/span>

本文介绍了如何在AWS上构建流式处理系¾lŸã€‚包括了诸如Amazon Kinesis ã€?/span>AWS Lambdaã€?/span>Kineses S3 connector之类½Ž€å•çš„搭配æ–ÒŽ¡ˆåQŒä¹Ÿä»‹ç»äº?/span>AWS实现实时分析场景˜q™æ ·ç›¸å¯¹å¤æ‚点的æ–ÒŽ¡ˆã€?/span>

http://cdn.oreillystatic.com/en/assets/1/event/144/Building%20a%20scalable%20architecture%20for%20processing%20streaming%20data%20on%20AWS%20Presentation.pdf

 

本文介绍了怎样使用Spark Testing Baseã€?/span>Spark Testing Base是一个用Scala¾~–写åQŒé€šè¿‡Java调用çš?/span>Spark‹¹‹è¯•æ¡†æž¶ã€‚本文的样例代码展示了如何隔¼›ÀLµ‹è¯•é€»è¾‘重构Spark代码åQŒåŒæ—¶è¿˜é€šè¿‡Java处理了一些臃肿的Scala APIã€?/span>

http://www.jesse-anderson.com/2016/04/unit-testing-spark-with-java/

 

Altiscale博客概述了在Spark环境下,构徏thinå’?/span>uber jar包的优劣。示范了åœ?/span>Mavenå’?/span>SBT分别构徏两种包的情况ã€?/span>

https://www.altiscale.com/blog/spark-on-hadoop-thin-jars/

 

LinkedIn介绍了他们的Kafka生态系¾lŸï¼Œç”Ÿæ€ç³»¾lŸåŒ…含一个特ŒDŠçš„Kafka produceråQŒä¸€ä¸ªäؓé?/span>Java客户端提供的REST APIåQŒä¸€ä¸?/span>avro模式注册表,以及GobblinåQˆè£…载数据到Hadoop的工å…øP¼‰½{‰ç­‰ã€?/span>

https://engineering.linkedin.com/blog/2016/04/kafka-ecosystem-at-linkedin

 

è¯?/span>Spark Streaming教程介绍了怎样通过twitter4j API拉推文,åŸÞZºŽæ ‡ç­¾˜q‡æ×oåQŒå¯¹æŽ¨æ–‡˜q›è¡Œæƒ…感分析ã€?/span>

https://www.mapr.com/blog/spark-streaming-and-twitter-sentiment-analysis

 

Apache KuduåQˆå­µåŒ–中åQ‰æ˜¯Apache ImpalaåQˆå­µåŒ–中åQ‰çš„¾lä½³ä¼´äÇGåQŒå› ä¸ºå®ƒèƒ½é«˜æ•ˆåœ°è§£å†³òq¿æ³›çš„分析和有针å¯ÒŽ€§çš„查询。本文描˜qîCº†ä¸¤è€…集成的技术细节,例如Kudu的设计如何保证高效地查询能力åQŒå¦‚何通过Impalaå’?/span>Kudu执行写/更新åQåˆ é™¤æ“ä½œç­‰½{‰ã€?/span>

http://blog.cloudera.com/blog/2016/04/how-to-use-impala-and-kudu-together-for-analytic-workloads/

 

MapR撰文介绍了ä‹Éç”?/span>spark-sklearn扩展一个已存在çš?/span>scikit-learn模型。文章介¾läº†å¦‚何透过Airbnb数据集内部徏模,˜q˜ä»‹¾läº†å¦‚何傍着spark-sklearn˜q›è¡Œäº¤å‰éªŒè¯ã€?/span>

https://www.mapr.com/blog/predicting-airbnb-listing-prices-scikit-learn-and-apache-spark

 

AWS大数据博客写了个如何åœ?/span>Amazon EMR中ä‹Éç”?/span>HBaseå’?/span>Hive的教½E‹ã€‚本教程介绍äº?/span>HBaseåQŒæ˜qîCº†å¦‚何åœ?/span>S3中恢å¤?/span>HBase表,½Cø™Œƒäº?/span>Hiveå’?/span>HBase如何集成½{‰ç­‰ã€?/span>

http://blogs.aws.amazon.com/bigdata/post/Tx3EGE8Z90LZ9WX/Combine-NoSQL-and-Massively-Parallel-Analytics-Using-Apache-HBase-and-Apache-Hiv

 

本文描述了äؓ学生在大数据评¡¨‹ä¸Šæä¾›å®žæˆ˜ç»éªŒçš„挑战。作者经历若òq²æ¬¡çš„è„P代和选择ä¼ég¹Žæœ‰äº†ä¸€ä¸ªå¥½æ–ÒŽ¡ˆ Altiscaleçš?/span>Hadoop-as-a-Serviceã€?/span>

https://www.altiscale.com/blog/hadoop-as-a-service-in-the-classroom/

 

Cloudera博客的一½‹‡å®¢åšæ–‡ç« ï¼Œä½œè€…比较了Parquetå’?/span>Avro在跨两个数据集的不同处理方式åQˆä¸€ä¸ªæ•°æ®é›†½H?/span>(3åˆ?/span>)、一个数据集å®?/span>(103åˆ?/span>)åQ‰ã€‚在ç”?/span>Sparkå’?/span>Spark SQL‹¹‹è¯•æŸ¥è¯¢åQæ“ä½œåŽåQŒä½œè€…发çŽ?/span>Parquetå’?/span>Avro在查询序列化数据斚w¢æœ‰æ—¶è¡¨çŽ°å¾ˆç±»ä¼û|¼Œž®½ç®¡åœ¨å¤§å¤šæ•°æƒ…况下查è¯?/span>Parquet数据的时候更快点åQˆåºåˆ—化数据更小åQ‰ã€?/span>

http://blog.cloudera.com/blog/2016/04/benchmarking-apache-parquet-the-allstate-experience/

 

本文介绍了如何在CDH˜q™æ ·çš„分布式环境中ä‹Éç”?/span>SparkRåQŒå°½½Ž?/span>SparkR官方˜q˜æ²¡æœ‰æ”¯æŒè¿™¿Uæ–¹å¼ã€‚借助YARNåœ?/span>worker本地安装R语言包,job½EåŠ æ”šw€ å°±èƒ½æ‰§è¡Œäº†ã€?/span>

http://www.nodalpoint.com/sparkr-in-cloudera-hadoop/

 

很多开源框枉™ƒ½èƒ½æ‰§è¡?/span>MapReduce以及借助更高¾U§çš„¾~–程模型完成¾cÖM¼¼çš„工作。纵观过去,它们依赖独立˜qè¡Œçš„框æžÓž¼ˆä¾‹å¦‚MapReduce, StormåQ‰ï¼Œä½†æ˜¯æœ€˜q‘的某些变化使得˜q™ä¸€åˆ‡å……满了变数ã€?/span>Apache BeamåQˆå­µåŒ–中åQ‰æ›´˜q›ä¸€æ­¥åœ°è·¨è¶Šäº†æ‰¹å¤„理、流式处理两¿Uæ‰§è¡Œæ¨¡å¼ï¼Œå†…置更加复杂的计½Ž—模型ã€?/span>

http://www.datanami.com/2016/04/22/apache-beam-emerges-ambitious-goal-unify-big-data-development/

 

Apache博客发布äº?/span>HBaseåœ?/span>HDDã€?/span>SSD以及RAMDISK上的写入性能‹¹‹è¯•æ¯”对çš?/span>7½‹‡ç³»åˆ—文章。通过˜q™ä¸€åˆ†æžåQŒä½œè€…发现åƈ提议åœ?/span>HBaseå’?/span>HDFS上实çŽîC¸€äº›æœªè¦†ç›–的功能ã€?/span>

https://blogs.apache.org/hbase/entry/hdfs_hsm_and_hbase_part

 

其他新闻

Tom WhiteåQ?/span>“Hadoop权威指南的作者撰文介¾lä»–是如何步å…?/span>Apache HadoopŒD¿å ‚的。他的早期èµA献是¾l•ç€Hadoopä¸?/span>Amazon Web Services集成展开åQŒè€Œä»ŠAWS已成ä¸?/span>Hadoop™å¹ç›®æˆåŠŸçš„重要部分ã€?/span>

http://vision.cloudera.com/how-i-got-into-hadoop/

 

FluoåQŒäؓApache Accumulo准备的分布式处理引擎åQŒå‘Apache孵化器提交了孵化甌™¯·ã€?/span>

https://wiki.apache.org/incubator/FluoProposal

 

Apache Phoenix宣布ž®†åœ¨HBaseCon后ä‹D行会议,Apache Phoenix是一ä¸?/span>SQL-on-HBase¾pȝ»Ÿã€‚该会议只有半天åQŒä¸»é¢˜æ˜¯ä»‹ç»Phoenix内部情况和用例ã€?/span>

http://hortonworks.com/blog/announcing-first-annual-phoenixcon-apache-phoenix-user-conference/

 

产品发布

Apache MetronåQŒæž„å»ÞZºŽHadoop上的安全框架åQŒå‘布了0.1版ã€?/span>Hortonworks支撑其作为技术预览版åQŒåƈ撰写本文介绍了如何上手,如何贡献åQŒå¦‚何ä‹Éç”?/span>Metron UI½{‰ç­‰ã€?/span>

http://hortonworks.com/blog/apache-metron-tech-preview-1-come-get/

http://hortonworks.com/blog/apache-metron-use-case-finding-needle-haystack/

 

Apache NiFi本周发布äº?/span>0.6.1版。这是修复了10多个bug后的修复版ã€?/span>

http://mail-archives.us.apache.org/mod_mbox/www-announce/201604.mbox/%3CCALJK9a7yLnFeJ7Z=eU6mOB-DXvo8MHUr=_RshSjZcTbTcAHDZA@mail.gmail.com%3E

 

Apache Flink本周发布äº?/span>1.0.2版。本‹Æ¡å‘布包括了bug修复åQ?/span>RocksDB环境下的性能提升以及一些文档方面的˜q›æ­¥ã€?/span>

http://flink.apache.org/news/2016/04/22/release-1.0.2.html

 

Amazon发布了新ç‰?/span>Amazon EMRåQŒå¼€å§‹æ”¯æŒ?/span>HBase 1.2ã€?/span>

https://aws.amazon.com/blogs/aws/amazon-emr-update-apache-hbase-1-2-is-now-available/

 

‹zÕdŠ¨

中国

æ—?/span>



]]>
Hadoop周刊—第 166 æœ?/title><link>http://www.qpkxbc.shop/rosen/archive/2016/04/21/430176.html</link><dc:creator>Rosen</dc:creator><author>Rosen</author><pubDate>Thu, 21 Apr 2016 07:07:00 GMT</pubDate><guid>http://www.qpkxbc.shop/rosen/archive/2016/04/21/430176.html</guid><wfw:comment>http://www.qpkxbc.shop/rosen/comments/430176.html</wfw:comment><comments>http://www.qpkxbc.shop/rosen/archive/2016/04/21/430176.html#Feedback</comments><slash:comments>0</slash:comments><wfw:commentRss>http://www.qpkxbc.shop/rosen/comments/commentRss/430176.html</wfw:commentRss><trackback:ping>http://www.qpkxbc.shop/rosen/services/trackbacks/430176.html</trackback:ping><description><![CDATA[<p><strong><span style="font-size:16.0pt">Hadoop</span></strong><strong><span style="font-size:16.0pt;font-family: 宋体;">周刊</span></strong><strong> </strong><strong><span style="font-size:16.0pt;font-family:宋体;">½W?/span></strong><strong><span style="font-size:16.0pt"> 166 </span></strong><strong><span style="font-size: 16.0pt;font-family:宋体;">æœ?/span></strong><strong></strong></p> <p><span style="font-size:14.0pt">2016</span><span style="font-size:14.0pt;font-family:宋体;">òq?/span><span style="font-size:14.0pt">4</span><span style="font-size:14.0pt; font-family:宋体;">æœ?/span><span style="font-size:14.0pt">17</span><span style="font-size:14.0pt;font-family: 宋体;">æ—?/span></p> <p>启明星辰——òq›_°å’Œå¤§æ•°æ®æ•´ä½“¾l„ç¼–è¯?nbsp;<br /><br /></p> <p><span style="font-family:Helvetica;">Hortonworks</span><span style="font-family: 宋体;">在本å‘?/span><span style="font-family:Helvetica;">Hadoop</span><span style="font-family:宋体;">‹Æ§æ´²å³îC¼šä¸Šæœ‰è‹¥å¹²çˆ†æ–™åQŒè¯½I¿äº†æœ¬æœŸæ•´ä¸ªå†…容。伴随着骄äh的新ç‰ÒŽ€§ï¼Œ</span><span style="font-family:Helvetica;">Apache Storm</span><span style="font-family:宋体;">发布äº?/span><span style="font-family:Helvetica;">1.0.0</span><span style="font-family:宋体;">版。在技术新é—ÀL–¹é¢ï¼Œæœ‰ä¸ž®‘基äº?/span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">构徏大规模服务和分布式系¾lŸæµ‹è¯•çš„文章。如果你错过äº?/span><span style="font-family:Helvetica;">Hadoop</span><span style="font-family:宋体;">å³îC¼šåQŒé‚£ä¹ˆä¸ç”¨æ‹…心,演讲视频已经攑ֈ°äº†ç½‘上ã€?/span></p> <p> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">技术新é—?/span></strong><strong></strong></p> <p> </p> <p><span style="font-family:Helvetica;">Smyte</span><span style="font-family:宋体;">撰文介绍了他们基于事件数据流实时‹‚€‹¹‹åžƒåœùN‚®ä»¶å’Œè¯ˆéª—信息的基¼‹€è®¾æ–½ã€‚最初的事äšg处理¾pȝ»Ÿæž„徏åœ?/span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Redis</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Secor</span><span style="font-family:宋体;">以及</span><span style="font-family:Helvetica;">S3</span><span style="font-family:宋体;">上,ä¸ÞZº†æ»¡èƒö规模不断扩张和廉ä»ïLš„要求åQŒä»–们把¾pȝ»Ÿ˜qç§»åˆ°åŸºäºŽç£ç›˜çš„æ–ÒŽ¡ˆä¸Šï¼Œä½¿ç”¨</span><span style="font-family:Helvetica;">Redis</span><span style="font-family:宋体;">协议ä¸?/span><span style="font-family:Helvetica;">RocksDB</span><span style="font-family:宋体;">交互åQŒä‹Éç”?/span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">˜q›è¡Œå¤åˆ¶ã€?/span></p> <p><a href="https://medium.com/the-smyte-blog/counting-with-domain-specific-databases-73c660472da"><span style="font-family:Helvetica;">https://medium.com/the-smyte-blog/counting-with-domain-specific-databases-73c660472da</span></a></p> <p><u> </u></p> <p><span style="font-family:宋体;">本文æŠ?/span><span style="font-family:Helvetica;">rsyslog</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">AWS </span><span style="font-family:宋体;">ä¸?/span><span style="font-family:Helvetica;">ELK</span><span style="font-family:宋体;">栈(</span><span style="font-family:Helvetica;">ElasticSearch</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Logstash</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Kibana</span><span style="font-family:宋体;">åQ‰ç»“合,处理诸如反压、规模以及维护方面的问题。本文覆盖了</span><span style="font-family:Helvetica;">rsyslog</span><span style="font-family:宋体;">集成</span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">以及</span><span style="font-family:Helvetica;">schema</span><span style="font-family:宋体;">斚w¢çš„技巧,也介¾läº†å¦‚何˜qè¡Œ</span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Zookeeper</span><span style="font-family:宋体;">以及</span><span style="font-family:Helvetica;">AWS</span><span style="font-family:宋体;">中大规模自动分组ã€?/span></p> <p><a href="https://www.bashton.com/blog/2016/elk-on-ark/"><span style="font-family: Helvetica;">https://www.bashton.com/blog/2016/elk-on-ark/</span></a></p> <p><u> </u></p> <p><span style="font-family:Helvetica;">Hortonworks</span><span style="font-family: 宋体;">撰文介绍äº?/span><span style="font-family:Helvetica;">Apache Atlas</span><span style="font-family:宋体;">以及</span><span style="font-family:Helvetica;">Apache Range</span><span style="font-family:宋体;">ž®†è¦å¼•å…¥çš„数据管理特性。这些特性是åQšåˆ†¾c»è®¿é—®æŽ§åˆ¶ã€æ•°æ®æœ‰æ•ˆæœŸ½{–略、位¾|®ç‰¹æ€§ç­–略、禁止数据集¾l„合、跨¾l„äšg家族åQˆä¾‹å¦‚从</span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">åˆ?/span><span style="font-family:Helvetica;">Storm</span><span style="font-family:宋体;">再到</span><span style="font-family:Helvetica;">Hive</span><span style="font-family:宋体;">的数据跟ítªï¼‰ã€?/span></p> <p><a href="http://hortonworks.com/blog/the-next-generation-of-hadoop-based-security-data-governance/"><span style="font-family:Helvetica;">http://hortonworks.com/blog/the-next-generation-of-hadoop-based-security-data-governance/</span></a></p> <p><u> </u></p> <p><span style="font-family:Helvetica;">Apache HAWQ </span><span style="font-family: 宋体;">åQˆå­µåŒ–中åQ‰æ˜¯ä¸€ä¸ªåŸºäº?/span><span style="font-family: Helvetica;">Greenplum</span><span style="font-family:宋体;">åœ?/span><span style="font-family:Helvetica;">HDFS</span><span style="font-family:宋体;">上提供数据查询的</span><span style="font-family:Helvetica;">SQL</span><span style="font-family:宋体;">引擎。本文讨è®ÞZº†å…¶å…¸åž‹è®¾è®¡ä»¥åŠæ–°ç‰ˆæœ¬çš„诸多改˜q›ã€‚包括它ä¸?/span><span style="font-family: Helvetica;">Spark</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">MapReduce</span><span style="font-family:宋体;">的区别,˜q˜æœ‰äº?/span><span style="font-family:Helvetica;">Hadoop</span><span style="font-family:宋体;">挑战¾lå…¸</span><span style="font-family:Helvetica;">MPP</span><span style="font-family:宋体;">设计的内容,以及</span><span style="font-family:Helvetica;">HAWQ</span><span style="font-family:宋体;">的新设计怎样¾l“合</span><span style="font-family:Helvetica;">MPP</span><span style="font-family:宋体;">和批处理技术进而ä‹É其两者兼™å¾ã€?/span></p> <p><a href="https://blog.pivotal.io/big-data-pivotal/products/apache-hawq-next-step-in-massively-parallel-processing"><span style="font-family:Helvetica;">https://blog.pivotal.io/big-data-pivotal/products/apache-hawq-next-step-in-massively-parallel-processing</span></a></p> <p> </p> <p><span style="font-family:Helvetica;">Cloudera</span><span style="font-family:宋体;">博客撰文介绍了对</span><span style="font-family:Helvetica;">Hadoop</span><span style="font-family:宋体;">分布式系¾lŸè¿›è¡Œæ•…障注入、组¾|‘çš„‹¹‹è¯•å·¥å…·</span><span style="font-family:Helvetica;">AgenTEST</span><span style="font-family:宋体;">。它能注入网¾lœæ•…障(例如丢包åQ‰ï¼Œèµ„源满蝲åQˆä¾‹å¦?/span><span style="font-family:Helvetica;">CPU</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">IO</span><span style="font-family:宋体;">、磁盘空é—ß_¼‰½{‰ç­‰ã€‚当‹¹‹è¯•¾|‘络分区æ—Óž¼Œå¯ä»¥è¯„估环å޾l„网、桥接组¾|‘ç­‰½{‰ã€?/span></p> <p><a href="http://blog.cloudera.com/blog/2016/04/quality-assurance-at-cloudera-fault-injection-and-elastic-partitioning/"><span style="font-family:Helvetica;">http://blog.cloudera.com/blog/2016/04/quality-assurance-at-cloudera-fault-injection-and-elastic-partitioning/</span></a></p> <p><u> </u></p> <p><span style="font-family:Helvetica;">Hortonworks</span><span style="font-family: 宋体;">博客展望了将包含新版æœ?/span><span style="font-family: Helvetica;">Spark</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">Zeppelin</span><span style="font-family:宋体;">çš?/span><span style="font-family:Helvetica;">HDP 2.4.2</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Spark2.0</span><span style="font-family:宋体;">预览版和</span><span style="font-family:Helvetica;">Zeppelin</span><span style="font-family:宋体;">新特性都ž®†åŒ…含在内ã€?/span></p> <p><a href="http://hortonworks.com/blog/apache-spark-apache-zeppelin-whats-coming-in-hdp-2-4-2/"><span style="font-family:Helvetica;">http://hortonworks.com/blog/apache-spark-apache-zeppelin-whats-coming-in-hdp-2-4-2/</span></a></p> <p><u> </u></p> <p><span style="font-family:Helvetica;">Cask</span><span style="font-family:宋体;">撰文介绍了在</span><span style="font-family:Helvetica;">Hbase region compaction</span><span style="font-family:宋体;">˜q™æ ·¾|•è§äº‹äšg发生的前后,他们是怎样通过长时间测试以评估分布式系¾lŸæ­£¼‹®æ€§çš„ã€?/span></p> <p><a href="http://blog.cask.co/2016/04/long-running-tests-in-cdap/"><span style="font-family:Helvetica;">http://blog.cask.co/2016/04/long-running-tests-in-cdap/</span></a></p> <p><u> </u></p> <p><span style="font-family:宋体;">本文介绍了如何结å?/span><span style="font-family:Helvetica;">SparkR</span><span style="font-family:宋体;">与亚马é€?/span><span style="font-family:Helvetica;">EMR</span><span style="font-family:宋体;">˜q›è¡Œåœ°ç†½Iºé—´åˆ†æžçš„。通过</span><span style="font-family: Helvetica;">SparkR</span><span style="font-family:宋体;">çš?/span><span style="font-family:Helvetica;">Hive</span><span style="font-family:宋体;">集成¾l„äšgåQŒå¯ä»¥ç«‹åˆÕdŸºäº?/span><span style="font-family:Helvetica;">S3</span><span style="font-family:宋体;">上的数据映射</span><span style="font-family:Helvetica;">Hive</span><span style="font-family:宋体;">外部表。从˜q™å¼€å§‹ï¼Œæ•°æ®ž®Þpƒ½ç›´æŽ¥åŠ è²åˆ°å†…存中使用</span><span style="font-family:Helvetica;">R</span><span style="font-family:宋体;">语言分析åQŒå¾ˆå®ÒŽ˜“实现高质量的数据可视化ã€?/span></p> <p><a href="http://blogs.aws.amazon.com/bigdata/post/Tx1MECZ47VAV84F/Exploring-Geospatial-Intelligence-using-SparkR-on-Amazon-EMR"><span style="font-family:Helvetica;">http://blogs.aws.amazon.com/bigdata/post/Tx1MECZ47VAV84F/Exploring-Geospatial-Intelligence-using-SparkR-on-Amazon-EMR</span></a></p> <p><u> </u></p> <p><span style="font-family:Helvetica;">MapR</span><span style="font-family:宋体;">¾~–写了ä‹Éç”?/span><span style="font-family:Helvetica;">Pig</span><span style="font-family:宋体;">å’?/span><span style="font-family:Helvetica;">Hive</span><span style="font-family:宋体;">分析职业‹‚’球大联盟球队水òq³çš„教程ã€?/span><span style="font-family:Helvetica;">Pig</span><span style="font-family:宋体;">用于数据初加工,</span><span style="font-family:Helvetica;">Hive</span><span style="font-family:宋体;">提供åŸÞZºŽ</span><span style="font-family:Helvetica;">SQL</span><span style="font-family:宋体;">的数据查询环境。借助</span><span style="font-family:Helvetica;">Hive ODBC</span><span style="font-family:宋体;">驱动å’?/span><span style="font-family:Helvetica;">Hive</span><span style="font-family:宋体;">服务器,使得微èÊY</span><span style="font-family:Helvetica;">Excel</span><span style="font-family:宋体;">也能用于获取和分析数据ã€?/span></p> <p><a href="https://www.mapr.com/blog/using-hive-and-pig-baseball-statistics"><span style="font-family:Helvetica;">https://www.mapr.com/blog/using-hive-and-pig-baseball-statistics</span></a></p> <p><u> </u></p> <p><span style="font-family:Helvetica;">SignalFX</span><span style="font-family:宋体;">通过</span><span style="font-family:Helvetica;">27</span><span style="font-family:宋体;">节点çš?/span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">集群每天处理</span><span style="font-family:Helvetica;">700</span><span style="font-family:宋体;">多亿条消息。只有基于他们积累的大规æ¨?/span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">使用¾léªŒæ‰èƒ½æœ‰å¦‚此高的量åQŒå› æ­¤ä»–们共享了不少调试</span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">的技巧,定位告警åQˆä¾‹å¦‚日志刷新åšg˜qŸå¢žåŠ ï¼‰åQŒä»¥å?/span><span style="font-family:Helvetica;">Kafka</span><span style="font-family:宋体;">横向扩展ã€?/span></p> <p><a href="http://www.confluent.io/blog/how-we-monitor-and-run-kafka-at-scale-signalfx"><span style="font-family:Helvetica;">http://www.confluent.io/blog/how-we-monitor-and-run-kafka-at-scale-signalfx</span></a></p> <p><u> </u></p> <p><span style="font-family:Helvetica;">dataArtisan's</span><span style="font-family: 宋体;">博客ä¸ÞZº†åº¦é‡</span><span style="font-family:Helvetica;">Flink</span><span style="font-family:宋体;">在数据流效率、低延迟、正¼‹®æ€§ä¸Šçš„能力,专门写了˜q™ç¯‡æ–‡ç« ã€‚äؓ了证明效率,在高吞吐量的环境下运行了最新的</span><span style="font-family:Helvetica;">Yahoo!</span><span style="font-family:宋体;">‹¹å¼åŸºå‡†‹¹‹è¯•½E‹åºã€‚在正确性方面,文章½Hå‡ºäº?/span><span style="font-family:Helvetica;">Flink</span><span style="font-family:宋体;">事äšg判别和处理事ä»Óž¼ˆæ˜Ÿçƒå¤§æˆ˜ç”µåª„òq´è¡¨åšç±»æ¯”)斚w¢çš„优åŠÑ€‚最后,文章描述äº?/span><span style="font-family:Helvetica;">Flink</span><span style="font-family:宋体;">未来版本åŸÞZºŽå†…存的查询ä“Q务ã€?/span></p> <p><a href="http://data-artisans.com/counting-in-streams-a-hierarchy-of-needs/"><span style="font-family:Helvetica;">http://data-artisans.com/counting-in-streams-a-hierarchy-of-needs/</span></a></p> <p><strong> </strong></p> <p><span style="font-family:宋体;">本教½E‹ä»‹¾läº†æ€Žæ ·æŠ?/span>TCP Socket<span style="font-family:宋体;">中的文本数据‹¹è{换äؓ</span>Spark<span style="font-family:宋体;">‹¹å¼æ•°æ®æºã€?/span></p> <p align="left"><a href="https://medium.com/@anicolaspp/spark-custom-streaming-sources-e7d52da72e80"><span style="font-family:Helvetica;color:#386EFF;text-decoration:none;text-underline:none">https://medium.com/@anicolaspp/spark-custom-streaming-sources-e7d52da72e80</span></a></p> <p> </p> <p><span style="font-family:宋体;">本文介绍了在构徏</span><span style="font-family:Helvetica;">Hadoop</span><span style="font-family:宋体;">的时候怎样防止</span><span style="font-family:Helvetica;">AWS</span><span style="font-family:宋体;">证书</span><span style="font-family:宋体;">意外提交到补丁或</span><span style="font-family:Helvetica;">git</span><span style="font-family:宋体;">资源库。除</span><span style="font-family:Helvetica;">Hadoop</span><span style="font-family:宋体;">本èín外,本文˜q˜å¾è®®ä‹Éç”?/span><span style="font-family: Helvetica;">“git-secrets”</span><span style="font-family:宋体;">工具防止意外提交讉K—®</span><span style="font-family:Helvetica;">/</span><span style="font-family:宋体;">安全密钥。如果你用的æ˜?/span><span style="font-family:Helvetica;">Hadoop S3</span><span style="font-family:宋体;">åQŒè¿˜æŽ¨èäº†æ–°è¡¥ä¸ä¾›è¯„ä¼°ã€?/span></p> <p><a href="http://steveloughran.blogspot.co.uk/2016/04/testing-against-s3-and-object-stores.html"><span style="font-family:Helvetica;">http://steveloughran.blogspot.co.uk/2016/04/testing-against-s3-and-object-stores.html</span></a></p> <p><u> </u></p> <p><span style="font-family:Helvetica;">Big Data & Brews</span><span style="font-family:宋体;">采访äº?/span><span style="font-family:Helvetica;">MapR</span><span style="font-family:宋体;">çš?/span><span style="font-family:Helvetica;">Ted Dunning</span><span style="font-family: 宋体;">å’?/span><span style="font-family:Helvetica;">Jacques Nadeau</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Apache Arrow</span><span style="font-family:宋体;">也在本次采访范围内ã€?/span></p> <p align="left"><a href="https://www.youtube.com/watch?v=l3mDDKjDjMk"><span style="font-family: Helvetica;color:#386EFF; text-decoration:none;text-underline:none">https://www.youtube.com/watch?v=l3mDDKjDjMk</span></a></p> <p align="left"><a href="https://www.youtube.com/watch?v=Xo9CO0a0VJI"><span style="font-family: Helvetica;color:#386EFF; text-decoration:none;text-underline:none">https://www.youtube.com/watch?v=Xo9CO0a0VJI</span></a></p> <p> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">其他新闻</span></strong><strong></strong></p> <p><span style="font-family:Helvetica;">DataEngConf</span><span style="font-family: 宋体;">最˜q‘在旧金山召开。本文æ€È»“äº?/span><span style="font-family: Helvetica;">Uber</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Stripe</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Microsoft</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Instacart</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Jawbone</span><span style="font-family:宋体;">的发­a€å†…容。也介绍了会议主é¢?/span><span style="font-family:Helvetica;">“</span><span style="font-family:宋体;">数据¿U‘学在现实世界中是一个äñ”品和工程学科</span><span style="font-family:Helvetica;">”</span><span style="font-family:宋体;">ã€?/span></p> <p><a href="https://medium.com/@eugmandel/software-engineering-invades-data-science-notes-from-dataengconf-4a3c066b081f#.g2h0duo44"><span style="font-family:Helvetica;">https://medium.com/@eugmandel/software-engineering-invades-data-science-notes-from-dataengconf-4a3c066b081f#.g2h0duo44</span></a></p> <p> </p> <p><span style="font-family:Helvetica;">Hortonworks</span><span style="font-family: 宋体;">在上周都柏林举行çš?/span><span style="font-family:Helvetica;">Hadoop</span><span style="font-family:宋体;">‹Æ§æ´²å³îC¼šä¸Šå¤§æ”‘Ö¼‚彩ã€?/span><span style="font-family:Helvetica;">ZDNet</span><span style="font-family:宋体;">报导了这些亮点,其中包括ä¸?/span><span style="font-family:Helvetica;">Pivotal</span><span style="font-family:宋体;">åQˆå·²è½¬å”®¾l?/span><span style="font-family:Helvetica;">HDP</span><span style="font-family:宋体;">åQ‰çš„扩展合作åQŒä¸Ž</span><span style="font-family:Helvetica;">Syncosrt</span><span style="font-family:宋体;">的è{售协议,以及</span><span style="font-family:Helvetica;">Atlas</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Ranger</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Zeppelin</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Metron</span><span style="font-family:宋体;">的技术预览。报å¯ÆD¿˜ä»‹ç»äº?/span><span style="font-family: Helvetica;">Hortonworks</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Cloudera</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">MapR</span><span style="font-family:宋体;">产品的不同之处ã€?/span></p> <p><a href="http://www.zdnet.com/article/hortonworks-announces-new-alliances-and-releases-hadoop-comes-to-fork-in-road/"><span style="font-family:Helvetica;">http://www.zdnet.com/article/hortonworks-announces-new-alliances-and-releases-hadoop-comes-to-fork-in-road/</span></a></p> <p><u> </u></p> <p><span style="font-family:Helvetica;">Flink 2016</span><span style="font-family:宋体;">å³îC¼šž®†åœ¨ä¹æœˆäºŽå¯d国柏林ä‹D行。讨è®ø™®®é¢˜å¾é›†å°†äºŽå…­æœˆæœ«¾l“束ã€?/span></p> <p><a href="http://flink.apache.org/news/2016/04/14/flink-forward-announce.html"><span style="font-family:Helvetica;">http://flink.apache.org/news/2016/04/14/flink-forward-announce.html</span></a></p> <p><u> </u></p> <p><span style="font-family:Helvetica;">YouTube</span><span style="font-family:宋体;">上发布了</span><span style="font-family:Helvetica;">Hadoop</span><span style="font-family:宋体;">都柏林峰会演讲视频。正如预期的那样åQŒè¿™äº›æ¼”讲内å®ÒŽ¶µç›?/span><span style="font-family:Helvetica;">Hadoop</span><span style="font-family:宋体;">生态系¾lŸçš„各个部分ã€?/span></p> <p><a href="https://www.youtube.com/channel/UCAPa-K_rhylDZAUHVxqqsRA/videos?flow=list&live_view=500&view=0&sort=dd">https://www.youtube.com/channel/UCAPa-K_rhylDZAUHVxqqsRA/videos?flow=list&live_view=500&view=0&sort=dd</a></p> <p> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">产品发布</span></strong><strong></strong></p> <p><span style="font-family:Helvetica;">Metascope</span><span style="font-family:宋体;">是一个配å?/span><span style="font-family:Helvetica;">Schedoscope</span><span style="font-family:宋体;">åœ?/span><span style="font-family:Helvetica;">Hadoop</span><span style="font-family:宋体;">集群中进行元数据½Ž¡ç†çš„新工具。通过</span><span style="font-family:Helvetica;">web</span><span style="font-family:宋体;">界面åQŒåˆ©ç”¨æ•°æ®æ²¿è¢­å®ƒèƒ½æ´žå¯Ÿå¤§é‡çš„数据。也提供‹‚€ç´¢ã€å†…嵌文档ã€?/span><span style="font-family: Helvetica;">REST API</span><span style="font-family:宋体;">½{‰ç­‰åŠŸèƒ½ã€?/span></p> <p><a href="https://github.com/ottogroup/metascope"><span style="font-family:Helvetica;">https://github.com/ottogroup/metascope</span></a></p> <p><u> </u></p> <p><span style="font-family:Helvetica;">Apache HBase 1.2.1</span><span style="font-family:宋体;">于本周发布,åœ?/span><span style="font-family:Helvetica;">1.2.0</span><span style="font-family:宋体;">的基¼‹€ä¸Šè§£å†³äº†</span><span style="font-family:Helvetica;">27</span><span style="font-family:宋体;">个问题。发布声明中重点介绍了四个高优先¾U§çš„问题ã€?/span></p> <p><a href="http://mail-archives.us.apache.org/mod_mbox/www-announce/201604.mbox/%3CCAN5cbe7-T5uAYvGRbxw2dfvdbwe5s0nx3vKU8Nt2fzXbKPoQTg@mail.gmail.com%3E"><span style="font-family:Helvetica;">http://mail-archives.us.apache.org/mod_mbox/www-announce/201604.mbox/%3CCAN5cbe7-T5uAYvGRbxw2dfvdbwe5s0nx3vKU8Nt2fzXbKPoQTg@mail.gmail.com%3E</span></a></p> <p> </p> <p><span style="font-family:Helvetica;">Apache Mahout</span><span style="font-family: 宋体;">机器学习库发布了</span><span style="font-family:Helvetica;">0.12.0</span><span style="font-family:宋体;">版。该版本çš?/span><span style="font-family:Helvetica;">“Samsara”</span><span style="font-family:宋体;">数学环境开始支æŒ?/span><span style="font-family:Helvetica;">Apache Flink</span><span style="font-family: 宋体;">了,òq¶ä¸”是åã^台无关的。发布声明中分äín了与</span><span style="font-family:Helvetica;">Flink</span><span style="font-family:宋体;">集成、已知问题、项目演˜q›è®¡åˆ’相关的内容ã€?/span></p> <p><a href="http://mail-archives.us.apache.org/mod_mbox/www-announce/201604.mbox/%3CCAOtpBjj5An876PStdn5kMeaF+up-B72WTmCk9j21EXdP=JOCUA@mail.gmail.com%3E"><span style="font-family:Helvetica;">http://mail-archives.us.apache.org/mod_mbox/www-announce/201604.mbox/%3CCAOtpBjj5An876PStdn5kMeaF+up-B72WTmCk9j21EXdP=JOCUA@mail.gmail.com%3E</span></a></p> <p><u> </u></p> <p><span style="font-family:Helvetica;">Apache Storm 1.0.0</span><span style="font-family:宋体;">本周发布了。亮点包括性能提升åQˆæ™®éæå?/span><span style="font-family:Helvetica;">3</span><span style="font-family:宋体;">倍以上)、新的分布式¾~“å­˜</span><span style="font-family:Helvetica;">API</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">nimbus</span><span style="font-family:宋体;">的高可用性、自动反压、动æ€?/span><span style="font-family:Helvetica;">worker</span><span style="font-family:宋体;">性能分析½{‰ç­‰ã€?/span></p> <p><a href="http://storm.apache.org/2016/04/12/storm100-released.html"><span style="font-family:Helvetica;">http://storm.apache.org/2016/04/12/storm100-released.html</span></a></p> <p><u> </u></p> <p><span style="font-family:Helvetica;">Apache Kudu</span><span style="font-family: 宋体;">åQˆå­µåŒ–中åQ‰æœ¬å‘¨å‘布了</span><span style="font-family: Helvetica;">0.8.0</span><span style="font-family:宋体;">版。本‹Æ¡å‘布添加了</span><span style="font-family:Helvetica;">Apache Flume sink</span><span style="font-family:宋体;">、部分功能提升、修复了一æ‰?/span><span style="font-family: Helvetica;">bug</span><span style="font-family:宋体;">ã€?/span></p> <p><a href="http://getkudu.io/releases/0.8.0/docs/release_notes.html"><span style="font-family:Helvetica;">http://getkudu.io/releases/0.8.0/docs/release_notes.html</span></a></p> <p><u> </u></p> <p align="left"><span style="font-family:Helvetica;">Cloudbreak</span><span style="font-family:宋体;">本周发布äº?/span><span style="font-family:Helvetica;">1.2</span><span style="font-family:宋体;">版,它äؓ云环境提ä¾?/span><span style="font-family:Helvetica;">Hadoop</span><span style="font-family:宋体;">集群</span><span style="font-family:Helvetica;">Docker</span><span style="font-family:宋体;">。新ç‰ÒŽ€§åŒ…括支æŒ?/span><span style="font-family:Helvetica;">OpenStack</span><span style="font-family:宋体;">以及ä¸ø™‡ªå®šä¹‰æœåŠ¡å™¨æä¾›é…¾|®è„šæœ¬ã€?/span></p> <p align="left"><a href="http://hortonworks.com/blog/announcing-cloudbreak-1-2/"><span style="font-family:Helvetica;">http://hortonworks.com/blog/announcing-cloudbreak-1-2/</span></a></p> <p align="left"><u> </u></p> <p align="left"><span style="font-family:Helvetica;">Cloudera</span><span style="font-family:宋体;">发布äº?/span><span style="font-family:Helvetica;">Cloudera Enterprise 5.4.10</span><span style="font-family:宋体;">åQŒå†…¾|®äº†</span><span style="font-family:Helvetica;">Flume</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Hadoop</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">HBase</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Hive</span><span style="font-family:宋体;">ã€?/span><span style="font-family:Helvetica;">Impala</span><span style="font-family:宋体;">½{‰ç»„件ã€?/span></p> <p align="left"><a href="http://community.cloudera.com/t5/Community-News-Release/ANNOUNCE-Cloudera-Enterprise-5-4-10-Released/m-p/39790#U39790"><span style="font-family:Helvetica;">http://community.cloudera.com/t5/Community-News-Release/ANNOUNCE-Cloudera-Enterprise-5-4-10-Released/m-p/39790#U39790</span></a></p> <p align="left"><u> </u></p> <p align="left"><span style="font-family:Helvetica;">Presto Accumulo</span><span style="font-family:宋体;">是个新项目,ä¸?/span><span style="font-family:Helvetica;">Accumulo</span><span style="font-family:宋体;">è¯Õd†™æ•°æ®æä¾›äº?/span><span style="font-family:Helvetica;">Presto</span><span style="font-family:宋体;">˜qžæŽ¥å™¨ã€?/span></p> <p align="left"><a href="https://github.com/bloomberg/presto-accumulo"><span style="font-family:Helvetica;">https://github.com/bloomberg/presto-accumulo</span></a></p> <p align="left"> </p> <p><strong><span style="font-size:15.0pt;font-family:宋体;">‹zÕdŠ¨</span></strong><strong></strong></p> <p align="left"><span style="font-size:14.0pt;font-family:SimSun;">中国</span></p> <p align="left"><span style="font-family:SimSun;">æ—?/span></p><img src ="http://www.qpkxbc.shop/rosen/aggbug/430176.html" width = "1" height = "1" /><br><br><div align=right><a style="text-decoration:none;" href="http://www.qpkxbc.shop/rosen/" target="_blank">Rosen</a> 2016-04-21 15:07 <a href="http://www.qpkxbc.shop/rosen/archive/2016/04/21/430176.html#Feedback" target="_blank" style="text-decoration:none;">发表评论</a></div>]]></description></item><item><title>Hadoop周刊—第 165 æœ?/title><link>http://www.qpkxbc.shop/rosen/archive/2016/04/14/430099.html</link><dc:creator>Rosen</dc:creator><author>Rosen</author><pubDate>Thu, 14 Apr 2016 10:02:00 GMT</pubDate><guid>http://www.qpkxbc.shop/rosen/archive/2016/04/14/430099.html</guid><wfw:comment>http://www.qpkxbc.shop/rosen/comments/430099.html</wfw:comment><comments>http://www.qpkxbc.shop/rosen/archive/2016/04/14/430099.html#Feedback</comments><slash:comments>0</slash:comments><wfw:commentRss>http://www.qpkxbc.shop/rosen/comments/commentRss/430099.html</wfw:commentRss><trackback:ping>http://www.qpkxbc.shop/rosen/services/trackbacks/430099.html</trackback:ping><description><![CDATA[<p><strong><span style="font-size:22.0pt;font-family:"Lantinghei SC Demibold"; color:#355400;">Hadoop</span><span style="font-size:22.0pt; font-family:"Lantinghei SC Demibold";color:#355400;">周刊</span></strong></p> <p><strong> </strong></p> <p><span style="font-size:14.0pt;font-family:"Lantinghei SC Demibold"; color:#355400;"><strong>½W?165 æœ?2016òq?æœ?0æ—?</strong></span></p> <p><span style="font-size:10.5pt;font-family:"Lantinghei SC Demibold"; color:#355400;"><strong>启明星辰——òq›_°å’Œå¤§æ•°æ®æ•´ä½“¾l„ç¼–è¯?/strong></span></p> <p> </p> <p><span style="font-size:12.0pt;line-height:135%; font-family:宋体;Times New Roman";Times New Roman";">本周åQŒåŒ…æ‹?/span><span style="font-size:12.0pt;line-height:135%">LinkedIn </span><span style="font-size:12.0pt;line-height:135%;font-family:宋体;Times New Roman";Times New Roman";">å’?/span><span style="font-size: 12.0pt;line-height:135%">Airbnb</span><span style="font-size:12.0pt;line-height: 135%;font-family:宋体;Times New Roman";Times New Roman";">新开源项目在内的æ•îC¸ªäº§å“˜q›è¡Œäº†é‡å¤§ç‰ˆæœ¬å‘布。本期技术部分与‹¹å¼å¤„理有关</span><span style="font-size:12.0pt;line-height:135%">——Spark</span><span style="font-size:12.0pt;line-height:135%;font-family:宋体;Times New Roman";Times New Roman";">ã€?/span><span style="font-size: 12.0pt;line-height:135%">Flink</span><span style="font-size:12.0pt;line-height: 135%;font-family:宋体;Times New Roman";Times New Roman";">ã€?/span><span style="font-size:12.0pt;line-height:135%">Kafka</span><span style="font-size:12.0pt;line-height:135%;font-family:宋体;Times New Roman";Times New Roman";">½{‰ç­‰åQ›æ–°é—»éƒ¨åˆ†æ˜¯å…³äºŽ</span><span style="font-size:12.0pt;line-height:135%">Spark Summit </span><span style="font-size:12.0pt;line-height:135%;font-family:宋体;Times New Roman";Times New Roman";">å’?/span><span style="font-size: 12.0pt;line-height:135%">HbaseCon</span><span style="font-size:12.0pt; line-height:135%;font-family:宋体;Times New Roman";Times New Roman";">的会议议½E‹ã€?/span></p> <h1><span style="font-family: 'Comic Sans MS'; font-size: 18pt;">技æœ?/span></h1> <p><span style="font-size:10.5pt;">Zalando</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman";">发表了他们是如何选择</span><span style="font-size:10.5pt;">Apache Flink</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman";">作äؓ‹¹å¼å¤„理框架的文章。该文章阐述了对评ä­h标准˜q›è¡ŒéªŒè¯åŽå¾—出的¾l“论åQŒé˜æ˜Žäº†é€‰æ‹©</span><span style="font-size:10.5pt;">Apache Flink</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman";">的主å›?/span><span style="font-size:10.5pt;">—</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman";">在高吞吐量的情况下依然能保持低åšg˜qŸï¼ŒçœŸæ­£çš„流式处理,开发äh员支持ã€?/span></p> <p><a href="https://tech.zalando.com/blog/apache-showdown-flink-vs.-spark/"><span style="font-size:10.5pt;font-family:"Helvetica Neue";Times New Roman";color:#0088CC;background:white">https://tech.zalando.com/blog/apache-showdown-flink-vs.-spark/</span></a></p> <p> </p> <p><span style="font-size:10.5pt">Cloudera</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">博客刊登了来è‡?/span><span style="font-size:10.5pt">Wargaming.net</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">的文章,通过本文可了解到他们如何通过</span><span style="font-size: 10.5pt">Kafka</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">ã€?/span><span style="font-size:10.5pt">HBase</span><span style="font-size:10.5pt;font-family: 宋体;Times New Roman";Times New Roman"">ã€?/span><span style="font-size:10.5pt">Drools</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">ã€?/span><span style="font-size:10.5pt">Spark</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">构徏实时处理基础设施的。另外,在数据流½E‹æ–¹é¢ï¼Œä»–们介绍了如何对</span><span style="font-size:10.5pt">HBase</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">的检索和序列化ã€?/span><span style="font-size:10.5pt">HBase</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">å’?/span><span style="font-size:10.5pt">Spark</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">之间的数据本地化以及</span><span style="font-size:10.5pt">Spark</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">计算斚w¢çš„优化措施ã€?/span></p> <p><a href="http://blog.cloudera.com/blog/2016/04/inside-wargamings-data-driven-real-time-rules-engine/"><span style="font-size:10.5pt;font-family:"Helvetica Neue";Times New Roman";color:#0088CC;background:white">http://blog.cloudera.com/blog/2016/04/inside-wargamings-data-driven-real-time-rules-engine/</span></a></p> <p> </p> <p><span style="font-size:10.5pt">InfoQ</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">发布了大规模‹¹å¼å¤„理</span><span style="font-size:10.5pt">—SMACK</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">åQ?/span><span style="font-size:10.5pt">Spark</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">ã€?/span><span style="font-size:10.5pt">Mesos</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">ã€?/span><span style="font-size:10.5pt">Akka</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">ã€?/span><span style="font-size:10.5pt">Cassandra</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">以及</span><span style="font-size:10.5pt"> Kafka</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">åQ‰æ ˆçš„介¾lè§†é¢‘。讨è®ÞZº†ä¸ÞZ»€ä¹?/span><span style="font-size:10.5pt">SMACK</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">栈在处理同样问题的时候比</span><span style="font-size:10.5pt">Lambda</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">架构更简单ã€?/span></p> <p><a href="http://www.infoq.com/presentations/stream-analytics-scalability"><span style="font-size:10.5pt;font-family:"Helvetica Neue";Times New Roman";color:#0088CC;background:white">http://www.infoq.com/presentations/stream-analytics-scalability</span></a></p> <p> </p> <p><span style="font-size:10.5pt">Confluent“</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">日志压羃</span><span style="font-size:10.5pt">”</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">¾pÕdˆ—博文又有更新åQŒä»‹¾läº†</span><span style="font-size:10.5pt">Kafka</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">™å¹ç›®ä¸‰æœˆä»½å‘生的事情。有不少令ähå…Ïx³¨çš„开发内容,包括机架感知ã€?/span><span style="font-size:10.5pt">Kerberos</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">支持、基于时间烦引方面的˜q›å±•ã€‚以及不ž®‘ä½ åQˆæˆ‘也是åQ‰æ²¡æœ‰æ—¶é—´æŒ¾l­å…³æ³¨çš„最新研发成果ã€?/span></p> <p><a href="http://www.confluent.io/blog/log-compaction-highlights-in-the-kafka-and-stream-processing-community-april-2016"><span style="font-size:10.5pt;font-family:"Helvetica Neue";Times New Roman";color:#0088CC;background:white">http://www.confluent.io/blog/log-compaction-highlights-in-the-kafka-and-stream-processing-community-april-2016</span></a></p> <p> </p> <p><span style="font-size:10.5pt">Apache Flink 1.0</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">引入了新的复杂事件处理(</span><span style="font-size:10.5pt">CEP</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">åQ‰åº“。啰嗦几句,</span><span style="font-size:10.5pt">CEP</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">提供了一¿Uæ£€‹¹‹äº‹ä»¶æ¨¡å¼çš„æ–ÒŽ³•ã€‚本文借助传感器从数据中心服务器上攉™›†æ•°æ®åQŒè¿ç”¨ä¸€¿Uå¯èƒ½çš„异常‹‚€‹¹‹ç”¨ä¾‹ï¼Œè¯ é‡Šäº?/span><span style="font-size:10.5pt">Flink</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">çš?/span><span style="font-size:10.5pt">CEP</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">模式</span><span style="font-size:10.5pt">API </span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">ã€?/span></p> <p><a href="http://flink.apache.org/news/2016/04/06/cep-monitoring.html"><span style="font-size:10.5pt;font-family:"Helvetica Neue";Times New Roman";color:#0088CC;background:white">http://flink.apache.org/news/2016/04/06/cep-monitoring.html</span></a></p> <p> </p> <p><span style="font-size:10.5pt">Genome Analysis Toolkit </span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">åQ?/span><span style="font-size:10.5pt">GATK</span><span style="font-size:10.5pt;font-family: 宋体;Times New Roman";Times New Roman"">åQ‰æœ€˜q‘宣布,下一个版本(当前æ˜?/span><span style="font-size:10.5pt">alpha</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">åQ‰å°†æ”¯æŒ</span><span style="font-size:10.5pt">Apache Spark</span><span style="font-size: 10.5pt;font-family:宋体;Times New Roman";Times New Roman"">。本文简要介¾läº†å·¥å…·½Ž±åƈ展示了怎样通过</span><span style="font-size:10.5pt">Spark</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">来检‹¹‹é‡å¤?/span><span style="font-size:10.5pt">DNA</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">片段的ã€?/span></p> <p><a href="http://blog.cloudera.com/blog/2016/04/genome-analysis-toolkit-now-using-apache-spark-for-data-processing/"><span style="font-size:10.5pt;font-family:"Helvetica Neue";Times New Roman";color:#0088CC;background:white">http://blog.cloudera.com/blog/2016/04/genome-analysis-toolkit-now-using-apache-spark-for-data-processing/</span></a></p> <p> </p> <p><span style="font-size:10.5pt">InfoWorld</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">¾lÆD¿°äº?/span><span style="font-size:10.5pt">Spark2.0</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">关于¾l“构化流式处理方面的计划。微批处理将依然延箋åQŒè¿˜æœ‰äº›æ–°ç‰¹æ€§ï¼Œä¾‹å¦‚无限数据帧(</span><span style="font-size:10.5pt">Infinite DataFrames</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">åQ‰ã€ä¸€‹¹çš„重复查询支持ã€?/span></p> <p><a href="http://www.infoworld.com/article/3052924/analytics/what-sparks-structured-streaming-really-means.html"><span style="font-size:10.5pt;font-family:"Helvetica Neue";Times New Roman";color:#0088CC;background:white">http://www.infoworld.com/article/3052924/analytics/what-sparks-structured-streaming-really-means.html</span></a></p> <p> </p> <p><span style="font-size:10.5pt">AWS</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">大数据博客发布了一½‹‡é€šè¿‡å­˜å‚¨åœ?/span><span style="font-size: 10.5pt">AWS Key Management Service </span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">åQ?/span><span style="font-size:10.5pt">KMS</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">åQ‰ä¸­çš„加密密钥加载数据到</span><span style="font-size:10.5pt">S3</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">å’?/span><span style="font-size:10.5pt">Redshift</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">的文章。除了描˜q°æ‰€éœ€æ­¥éª¤åQŒæœ¬æ–‡è¿˜ä»‹ç»äº†å¦‚何在</span><span style="font-size:10.5pt">AWS S3</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">中通过</span><span style="font-size:10.5pt">KMS</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">密钥加密数据ã€?/span></p> <p><a href="http://blogs.aws.amazon.com/bigdata/post/Tx2Q3ZBOZO9DHVQ/Encrypt-Your-Amazon-Redshift-Loads-with-Amazon-S3-and-AWS-KMS"><span style="font-size:10.5pt;font-family:"Helvetica Neue";Times New Roman";color:#0088CC;background:white">http://blogs.aws.amazon.com/bigdata/post/Tx2Q3ZBOZO9DHVQ/Encrypt-Your-Amazon-Redshift-Loads-with-Amazon-S3-and-AWS-KMS</span></a></p> <p> </p> <p><span style="font-size:10.5pt">Confluent</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">博客介绍了如何ä‹Éç”?/span><span style="font-size:10.5pt">Kafka Connect </span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">å’?/span><span style="font-size:10.5pt"> Kafka Streams </span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">¾~–写非凡çš?/span><span style="font-size:10.5pt">“hello world”</span><span style="font-size: 10.5pt;font-family:宋体;Times New Roman";Times New Roman"">½E‹åºã€‚æ›´¼‹®åˆ‡åœ°è¯´åQŒèŒƒä¾‹ç¨‹åºä»Ž</span><span style="font-size:10.5pt">IRC</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">拉维基百¿U‘数据,òq¶è§£æžæ¶ˆæ¯ã€è¿›è¡Œå¤šæ–šw¢çš„统计计½Ž—。本文还用了若干½E‹åºå±•ç¤ºäº†æ•´ä¸ªå®žçŽ°è¿‡½E‹ã€?/span></p> <p><a href="http://www.confluent.io/blog/hello-world-kafka-connect-kafka-streams"><span style="font-size:10.5pt;font-family:"Helvetica Neue";Times New Roman";color:#0088CC;background:white">http://www.confluent.io/blog/hello-world-kafka-connect-kafka-streams</span></a></p> <p> </p> <p style="line-height:107%"><span style="font-size:10.5pt; line-height:107%;font-family:宋体;Times New Roman";Times New Roman"">本文ä»?/span><span style="font-size:10.5pt; line-height:107%">Postgres </span><span style="font-size:10.5pt;line-height: 107%;font-family:宋体;Times New Roman";Times New Roman"">å?/span><span style="font-size:10.5pt;line-height:107%"> Cassandra</span><span style="font-size:10.5pt;line-height:107%;font-family:宋体;Times New Roman";Times New Roman"">转换½Ž€å•çš„模式åQ?/span><span style="font-size:10.5pt;line-height:107%">schemas</span><span style="font-size: 10.5pt;line-height:107%;font-family:宋体;Times New Roman";Times New Roman"">åQ‰ï¼Œòq¶æ˜qîCº†ä¸»è¦çš„å·®å¼?/span><span style="font-size:10.5pt; line-height:107%">—</span><span style="font-size:10.5pt;line-height:107%; font-family:宋体;Times New Roman";Times New Roman"">复制、数据类型(</span><span style="font-size:10.5pt;line-height:107%">Cassandra</span><span style="font-size:10.5pt;line-height:107%;font-family:宋体;Times New Roman";Times New Roman"">不支æŒ?/span><span style="font-size:10.5pt;line-height:107%">JSON</span><span style="font-size: 10.5pt;line-height:107%;font-family:宋体;Times New Roman";Times New Roman"">åQ‰ã€ä¸»é”®ã€æœ€¾lˆä»¥ä¸€è‡´æ€§ã€?/span></p> <p><a href="http://neovintage.org/2016/04/07/data-modeling-in-cassandra-from-a-postgres-perspective/"><span style="font-size:10.5pt;font-family:"Helvetica Neue";Times New Roman";color:#0088CC;background:white">http://neovintage.org/2016/04/07/data-modeling-in-cassandra-from-a-postgres-perspective/</span></a></p> <p> </p> <h1><span style="font-family: 'Comic Sans MS'; font-size: 18pt;">新闻</span></h1> <p style="line-height:107%"><span style="font-size: 10.5pt;line-height:107%">ESG</span><span style="font-size:10.5pt;line-height: 107%;font-family:宋体;Times New Roman";Times New Roman"">博客报导了最˜q?/span><span style="font-size:10.5pt;line-height:107%">Strata+Hadoop World</span><span style="font-size:10.5pt;line-height:107%;font-family:宋体;Times New Roman";Times New Roman"">大会的情å†üc€‚åƈ有些重点å…Ïx³¨åQŒä¾‹å¦?/span><span style="font-size:10.5pt;line-height:107%">Spark</span><span style="font-size:10.5pt;line-height:107%;font-family:宋体;Times New Roman";Times New Roman"">的良好势头、机器学习、云服务ã€?/span></p> <p><a href="http://blog.esg-global.com/riding-high-at-stratahadoop-world"><span style="font-size:10.5pt;font-family:"Helvetica Neue";Times New Roman";color:#0088CC;background:white">http://blog.esg-global.com/riding-high-at-stratahadoop-world</span></a></p> <p> </p> <p><span style="font-size:10.5pt">InformationWeek</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">也报å¯égº†</span><span style="font-size:10.5pt">Strata</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">大会åQŒå…³æ³¨äº†</span><span style="font-size:10.5pt">MapR</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">å’?/span><span style="font-size:10.5pt">Pivotal</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">的关灯片、äh工智能等ã€?/span></p> <p><a href="http://www.informationweek.com/big-data/ai-public-data-sets-real-time-strata-+-hadoop-keynote-sampling/d/d-id/1324943?"><span style="font-size:10.5pt;font-family:"Helvetica Neue";Times New Roman";color:#0088CC;background:white">http://www.informationweek.com/big-data/ai-public-data-sets-real-time-strata-+-hadoop-keynote-sampling/d/d-id/1324943?</span></a></p> <p> </p> <p><span style="font-size:10.5pt">Spark Summit 2016</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">议程敲定åQŒå°†äº?/span><span style="font-size:10.5pt">6</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">æœ?/span><span style="font-size:10.5pt">6-8</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">日在旧金å±×ƒ‹D行。会议将有两天展开五个方向的讨论ã€?/span></p> <p><a href="https://databricks.com/blog/2016/04/04/agenda-announced-for-sparksummit-2016-in-san-francisco.html"><span style="font-size:10.5pt;font-family:"Helvetica Neue";Times New Roman";color:#0088CC;background:white">https://databricks.com/blog/2016/04/04/agenda-announced-for-sparksummit-2016-in-san-francisco.html</span></a></p> <p> </p> <p><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">¼›å¸ƒæ–¯é‡‡è®¿äº†</span><span style="font-size:10.5pt">Cloudera CEO Tom Reilly</span><span style="font-size: 10.5pt;font-family:宋体;Times New Roman";Times New Roman"">åQŒä»–讨论了公司的机遇、竞争性市场、上市计划等ã€?/span></p> <p><a href="http://www.forbes.com/sites/roberthof/2016/04/06/ceo-tom-reilly-makes-the-case-for-cloudera-and-its-ipo/"><span style="font-size:10.5pt;font-family:"Helvetica Neue";Times New Roman";color:#0088CC;background:white">http://www.forbes.com/sites/roberthof/2016/04/06/ceo-tom-reilly-makes-the-case-for-cloudera-and-its-ipo/</span></a></p> <p> </p> <p><span style="font-size:10.5pt">Datanami</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">撰文ž®†æ­£åœ¨å´›èµïLš„</span><span style="font-size:10.5pt">Apache Kafka</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">作äؓ‹¹å¼å¤„理的支柱。文章还采访äº?/span><span style="font-size:10.5pt">Confluent</span><span style="font-size: 10.5pt;font-family:宋体;Times New Roman";Times New Roman"">联合创始人兼</span><span style="font-size:10.5pt">CTO Neha Narkhede</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">åQŒåŠé—´å¥¹è¡¨ç¤ºæœ€˜q‘将推出</span><span style="font-size:10.5pt">Kafka Connect </span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">å’?/span><span style="font-size:10.5pt"> Kafka Streams</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">ã€?/span></p> <p><a href="http://www.datanami.com/2016/04/06/real-time-rise-apache-kafka/"><span style="font-size:10.5pt;font-family:"Helvetica Neue";Times New Roman";color:#0088CC;background:white">http://www.datanami.com/2016/04/06/real-time-rise-apache-kafka/</span></a></p> <p> </p> <p><span style="font-size:10.5pt">HBaseCon</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">ž®†äºŽ</span><span style="font-size:10.5pt">5</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">æœ?/span><span style="font-size:10.5pt">24</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">日在旧金山召开åQŒæœ€˜q‘è®®½E‹æ‰æ­£å¼å®£å¸ƒã€‚在三个方向上,ž®†æœ‰</span><span style="font-size:10.5pt">20</span><span style="font-size:10.5pt;font-family: 宋体;Times New Roman";Times New Roman"">个以上的议题要讨论ã€?/span></p> <p><a href="http://blog.cloudera.com/blog/2016/04/hbasecon-2016-speaker-lineup-announced/"><span style="font-size:10.5pt;font-family:"Helvetica Neue";Times New Roman";color:#0088CC;background:white">http://blog.cloudera.com/blog/2016/04/hbasecon-2016-speaker-lineup-announced/</span></a></p> <p> </p> <h1><span style="font-family: 'Comic Sans MS'; font-size: 18pt;">发布</span></h1> <p> <span style="font-size:10.5pt">Apache HBase 0.98.18 </span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">å’?/span><span style="font-size:10.5pt">1.1.4</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">最˜q‘都发布了ã€?/span><span style="font-size:10.5pt">1.1.4</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">上有包括九个或正¼‹®æ€§åœ¨å†…的若干修复ã€?/span><span style="font-size: 10.5pt">HBase 0.98.18</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">¾Ÿžç­”½{”的仅解决了</span><span style="font-size:10.5pt">50</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">个问题(</span><span style="font-size:10.5pt">bug</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">、改善两个新ç‰ÒŽ€§ï¼‰ã€?/span></p> <p><a href="http://mail-archives.apache.org/mod_mbox/hbase-user/201603.mbox/%3CCANZa%3DGu-mAxKEtfoRjctHcE0KD7z52oE010Fgsf6AMmW2tDZLA%40mail.gmail.com%3E"><span style="font-size:10.5pt;font-family:"Helvetica Neue";Times New Roman";color:#0088CC;background:white">http://mail-archives.apache.org/mod_mbox/hbase-user/201603.mbox/%3CCANZa%3DGu-mAxKEtfoRjctHcE0KD7z52oE010Fgsf6AMmW2tDZLA%40mail.gmail.com%3E</span></a> <span style="font-size:10.5pt;font-family:"Helvetica Neue";Times New Roman";color:#333333"><br /> </span><a href="http://mail-archives.apache.org/mod_mbox/hbase-user/201603.mbox/%3CCA%2BRK%3D_CtZ1L07nS6Og2ekfVwet0qTE7jw-bmyD2pp5UPweUehQ%40mail.gmail.com%3E"><span style="font-size:10.5pt;font-family:"Helvetica Neue";Times New Roman";color:#0088CC;background:white">http://mail-archives.apache.org/mod_mbox/hbase-user/201603.mbox/%3CCA%2BRK%3D_CtZ1L07nS6Og2ekfVwet0qTE7jw-bmyD2pp5UPweUehQ%40mail.gmail.com%3E</span></a></p> <p> </p> <p><span style="font-size:10.5pt">Apache Lens</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">发布äº?/span><span style="font-size:10.5pt">2.5.0-beta</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">åQŒä½œä¸ºç»Ÿä¸€åˆ†æžæŽ¥å£åQŒå®ƒå·²ç»æ”¯æŒ</span><span style="font-size: 10.5pt">Hadoop</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">生态系¾lŸçš„执行引擎数据存储了。本‹Æ¡å‘布解决了</span><span style="font-size:10.5pt">87</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">¼œ¨ï¼Œä¸»è¦æ˜?/span><span style="font-size:10.5pt">bug</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">修复和实现新功能ã€?/span></p> <p><a href="http://mail-archives.us.apache.org/mod_mbox/www-announce/201604.mbox/%3CCAL3kmZj60kpopRPpOVEs9o7oTg7YuaC_=c8zncBeMyUESrZsmQ@mail.gmail.com%3E"><span style="font-size:10.5pt;font-family:"Helvetica Neue";Times New Roman";color:#0088CC;background:white">http://mail-archives.us.apache.org/mod_mbox/www-announce/201604.mbox/%3CCAL3kmZj60kpopRPpOVEs9o7oTg7YuaC_=c8zncBeMyUESrZsmQ@mail.gmail.com%3E</span></a></p> <p> </p> <p><span style="font-size:10.5pt">Airbnb </span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">开源了</span><span style="font-size:10.5pt"> Caravel</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">åQŒæ•°æ®æŽ¢ç´¢ç³»¾lŸï¼ˆæ•°æ®å¯è§†åŒ–åã^収ͼ‰ã€?/span><span style="font-size: 10.5pt">Caravel</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">支持多种在商业äñ”品上才能看到的特性,能够˜qžæŽ¥åˆîC“Q意只要支æŒ?/span><span style="font-size:10.5pt">SQL</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">方言的系¾lŸã€‚尤其它支持面向</span><span style="font-size:10.5pt">Druid</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">的实时分析ã€?/span></p> <p><a href="https://medium.com/airbnb-engineering/caravel-airbnb-s-data-exploration-platform-15a72aa610e5"><span style="font-size:10.5pt;font-family:"Helvetica Neue";Times New Roman";color:#0088CC;background:white">https://medium.com/airbnb-engineering/caravel-airbnb-s-data-exploration-platform-15a72aa610e5</span></a></p> <p> </p> <p><span style="font-size:10.5pt">MapR </span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">宣布支持</span><span style="font-size:10.5pt">Apache Drill 1.6</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">作äؓ他们的分布式¾pȝ»Ÿã€‚比较有亮点的发布有</span><span style="font-size:10.5pt;font-family:"Helvetica Neue";Times New Roman";color:#333333;background:white">MapR-DB</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">新存储插件、新</span><span style="font-size:10.5pt">SQL</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">½H—口函数支持以及端对端安全。在¾|‘页介绍部分åQŒæœ‰äº›ä‹Éç”?/span><span style="font-size:10.5pt;font-family:"Helvetica Neue";Times New Roman";color:#333333;background:white">MapR-DB API</span><span style="font-size:10.5pt;font-family:"MS Mincho";MS Mincho"; color:#333333;background:white">åŠ?/span><span style="font-size:10.5pt; font-family:SimSun;color:#333333;background:white">è½?/span><span style="font-size:10.5pt;font-family:"MS Mincho";MS Mincho"; color:#333333;background:white">数据òq‰™€?/span><span style="font-size:10.5pt; font-family:SimSun;color:#333333;background:white">˜q?/span><span style="font-size:10.5pt">Drill</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">查询的例子ã€?/span></p> <p><a href="https://www.mapr.com/blog/apache-drill-16-mapr-converged-platform-gearing-new-generation-stack-json-enabled-big-data"><span style="font-size:10.5pt;font-family:"Helvetica Neue";Times New Roman";color:#0088CC;background:white">https://www.mapr.com/blog/apache-drill-16-mapr-converged-platform-gearing-new-generation-stack-json-enabled-big-data</span></a></p> <p> </p> <p><span style="font-size:10.5pt">Apache Flink</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">发布了修å¤?/span><span style="font-size:10.5pt">bug</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">后的</span><span style="font-size:10.5pt">1.0.x</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">。这‹Æ¡å‘布解决了</span><span style="font-size:10.5pt">23</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">个问题,推荐所æœ?/span><span style="font-size:10.5pt">1.0.0</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">的用户升¾U§ã€?/span></p> <p><a href="http://flink.apache.org/news/2016/04/06/release-1.0.1.html"><span style="font-size:10.5pt;font-family:"Helvetica Neue";Times New Roman";color:#0088CC;background:white">http://flink.apache.org/news/2016/04/06/release-1.0.1.html</span></a></p> <p> </p> <p><span style="font-size:10.5pt">Cloudera Enterprise 5.7</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">发布附带äº?/span><span style="font-size:10.5pt">Spark</span><span style="font-size:10.5pt;font-family: 宋体;Times New Roman";Times New Roman"">ã€?/span><span style="font-size:10.5pt">HBase</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">ã€?/span><span style="font-size:10.5pt">Impala</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">ã€?/span><span style="font-size:10.5pt">Kafka</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">½{‰ç»„件版本的升çñ”。本‹Æ¡å‘布的亮点包括ä»?/span><span style="font-size:10.5pt">Cloudera Labs </span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">新鲜推荐çš?/span><span style="font-size:10.5pt">Hive-on-Spark</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">ã€?/span><span style="font-size:10.5pt">HBase-Spark</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">ã€?/span><span style="font-size:10.5pt">Impala</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">性能重要提升åQŒæ”¯æŒ?/span><span style="font-size:10.5pt">SSD </span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">ä¸?/span><span style="font-size:10.5pt">HBase WAL</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">ã€?/span></p> <p><a href="http://blog.cloudera.com/blog/2016/04/cloudera-enterprise-5-7-is-released/"><span style="font-size:10.5pt;font-family:"Helvetica Neue";Times New Roman";color:#0088CC;background:white">http://blog.cloudera.com/blog/2016/04/cloudera-enterprise-5-7-is-released/</span></a></p> <p> </p> <p><span style="font-size:10.5pt">Apache Tajo</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">åQŒæž„建在</span><span style="font-size:10.5pt">Hadoop</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">上的数据仓库¾pȝ»ŸåQŒå‘布了</span><span style="font-size:10.5pt">0.11.2</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">版。新版本支持äº?/span><span style="font-size:10.5pt">Kerberos</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">åQŒä¿®å¤äº†</span><span style="font-size:10.5pt">ORC</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">表对</span><span style="font-size:10.5pt">Hive</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">的支持等ã€?/span></p> <p><a href="http://tajo.apache.org/releases/0.11.2/announcement.html"><span style="font-size:10.5pt;font-family:"Helvetica Neue";Times New Roman";color:#0088CC;background:white">http://tajo.apache.org/releases/0.11.2/announcement.html</span></a></p> <p> </p> <p><span style="font-size:10.5pt">LinkedIn </span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">开源了</span><span style="font-size:10.5pt"> Dr. Elephant</span><span style="font-size:10.5pt;font-family:宋体;Times New Roman";Times New Roman"">åQŒé‡Œé¢çš„工具能诊æ–?/span><span style="font-size:10.5pt">Hadoop</span><span style="font-size:10.5pt;font-family: 宋体;Times New Roman";Times New Roman"">å’?/span><span style="font-size:10.5pt">Spark</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">ä»ÕdŠ¡çš„性能问题。基äº?/span><span style="font-size:10.5pt">metrics</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">ä»?/span><span style="font-size:10.5pt">YARN</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">资源½Ž¡ç†å™¨æ”¶é›†å·²å®Œæˆä»ÕdŠ¡æ•°æ®åQ?/span><span style="font-size:10.5pt">Dr. Elephant</span><span style="font-size: 10.5pt;font-family:宋体;Times New Roman";Times New Roman"">评估后生成诊断报表,内容包括数据错位ã€?/span><span style="font-size:10.5pt">GC</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">开销½{‰ã€?/span><span style="font-size:10.5pt">LinkedIn</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">宣称借助它能解决</span><span style="font-size:10.5pt">80%</span><span style="font-size:10.5pt; font-family:宋体;Times New Roman";Times New Roman"">的问题ã€?/span></p> <p><a href="https://engineering.linkedin.com/blog/2016/04/dr-elephant-open-source-self-serve-performance-tuning-hadoop-spark"><span style="font-size:10.5pt;font-family:"Helvetica Neue";Times New Roman";color:#0088CC;background:white">https://engineering.linkedin.com/blog/2016/04/dr-elephant-open-source-self-serve-performance-tuning-hadoop-spark</span></a></p> <p> </p> <h1><span style="font-family: 'Comic Sans MS'; font-size: 18pt;">‹zÕdŠ¨</span></h1> <p><strong><span style="font-size:16.0pt;font-family:宋体;Times New Roman";Times New Roman"">中国</span></strong><strong></strong></p> <p><span style="font-family:宋体;Times New Roman";Times New Roman"">æ—?/span></p><img src ="http://www.qpkxbc.shop/rosen/aggbug/430099.html" width = "1" height = "1" /><br><br><div align=right><a style="text-decoration:none;" href="http://www.qpkxbc.shop/rosen/" target="_blank">Rosen</a> 2016-04-14 18:02 <a href="http://www.qpkxbc.shop/rosen/archive/2016/04/14/430099.html#Feedback" target="_blank" style="text-decoration:none;">发表评论</a></div>]]></description></item><item><title>开源面向对象数据库 db4o 之旅: 使用 dRS “db4o 之旅åQˆå››åQ‰â€?/title><link>http://www.qpkxbc.shop/rosen/archive/2010/07/09/325618.html</link><dc:creator>Rosen</dc:creator><author>Rosen</author><pubDate>Fri, 09 Jul 2010 02:19:00 GMT</pubDate><guid>http://www.qpkxbc.shop/rosen/archive/2010/07/09/325618.html</guid><wfw:comment>http://www.qpkxbc.shop/rosen/comments/325618.html</wfw:comment><comments>http://www.qpkxbc.shop/rosen/archive/2010/07/09/325618.html#Feedback</comments><slash:comments>9</slash:comments><wfw:commentRss>http://www.qpkxbc.shop/rosen/comments/commentRss/325618.html</wfw:commentRss><trackback:ping>http://www.qpkxbc.shop/rosen/services/trackbacks/325618.html</trackback:ping><description><![CDATA[     摘要: 很多开发者对 hibernate 性能表示¾|®ç–‘åQŒä¸‹ä¸€‹Æ¡æŠ€æœ¯é©æ–îC¼šæ˜¯ä»€ä¹ˆå‘¢åQŸâ€”—对象数据库 <br>˜q™ç¯‡æ–‡ç« æ˜¯å¼€æºé¢å‘对象数据库 db4o 之旅 ¾pÕdˆ—文章的第 4 部分åQŒä»‹¾lé¢å‘对象数据库 db4o çš?db4o Replication System(dRS) —â€?db4o 复制¾pȝ»ŸåQŒåƈ对其如何同步 Oracle 数据库进行分析ã€?nbsp; <a href='http://www.qpkxbc.shop/rosen/archive/2010/07/09/325618.html'>阅读全文</a><img src ="http://www.qpkxbc.shop/rosen/aggbug/325618.html" width = "1" height = "1" /><br><br><div align=right><a style="text-decoration:none;" href="http://www.qpkxbc.shop/rosen/" target="_blank">Rosen</a> 2010-07-09 10:19 <a href="http://www.qpkxbc.shop/rosen/archive/2010/07/09/325618.html#Feedback" target="_blank" style="text-decoration:none;">发表评论</a></div>]]></description></item><item><title>使用SoftReference软引ç”?/title><link>http://www.qpkxbc.shop/rosen/archive/2010/06/22/324173.html</link><dc:creator>Rosen</dc:creator><author>Rosen</author><pubDate>Tue, 22 Jun 2010 07:27:00 GMT</pubDate><guid>http://www.qpkxbc.shop/rosen/archive/2010/06/22/324173.html</guid><wfw:comment>http://www.qpkxbc.shop/rosen/comments/324173.html</wfw:comment><comments>http://www.qpkxbc.shop/rosen/archive/2010/06/22/324173.html#Feedback</comments><slash:comments>2</slash:comments><wfw:commentRss>http://www.qpkxbc.shop/rosen/comments/commentRss/324173.html</wfw:commentRss><trackback:ping>http://www.qpkxbc.shop/rosen/services/trackbacks/324173.html</trackback:ping><description><![CDATA[     摘要: ˜q˜æ˜¯åšä¸ªå®žé™…çš„SoftReference‹¹‹è¯•å§ã€?nbsp; <a href='http://www.qpkxbc.shop/rosen/archive/2010/06/22/324173.html'>阅读全文</a><img src ="http://www.qpkxbc.shop/rosen/aggbug/324173.html" width = "1" height = "1" /><br><br><div align=right><a style="text-decoration:none;" href="http://www.qpkxbc.shop/rosen/" target="_blank">Rosen</a> 2010-06-22 15:27 <a href="http://www.qpkxbc.shop/rosen/archive/2010/06/22/324173.html#Feedback" target="_blank" style="text-decoration:none;">发表评论</a></div>]]></description></item><item><title>使用Memory Analyzer tool(MAT)分析内存泄漏åQˆäºŒåQ?/title><link>http://www.qpkxbc.shop/rosen/archive/2010/06/13/323522.html</link><dc:creator>Rosen</dc:creator><author>Rosen</author><pubDate>Sun, 13 Jun 2010 08:13:00 GMT</pubDate><guid>http://www.qpkxbc.shop/rosen/archive/2010/06/13/323522.html</guid><wfw:comment>http://www.qpkxbc.shop/rosen/comments/323522.html</wfw:comment><comments>http://www.qpkxbc.shop/rosen/archive/2010/06/13/323522.html#Feedback</comments><slash:comments>19</slash:comments><wfw:commentRss>http://www.qpkxbc.shop/rosen/comments/commentRss/323522.html</wfw:commentRss><trackback:ping>http://www.qpkxbc.shop/rosen/services/trackbacks/323522.html</trackback:ping><description><![CDATA[     摘要: 在åã^时工作过½E‹ä¸­åQŒæœ‰æ—¶ä¼šé‡åˆ°OutOfMemoryErroråQŒæˆ‘们知道遇到Error一般表明程序存在着严重问题åQŒå¯èƒ½æ˜¯çùNš¾æ€§çš„。所以找出是什么原因造成OutOfMemoryError非常重要。现在向大家引荐Eclipse Memory Analyzer tool(MAT)åQŒæ¥åŒ–解我们遇到的难题ã€?nbsp; <a href='http://www.qpkxbc.shop/rosen/archive/2010/06/13/323522.html'>阅读全文</a><img src ="http://www.qpkxbc.shop/rosen/aggbug/323522.html" width = "1" height = "1" /><br><br><div align=right><a style="text-decoration:none;" href="http://www.qpkxbc.shop/rosen/" target="_blank">Rosen</a> 2010-06-13 16:13 <a href="http://www.qpkxbc.shop/rosen/archive/2010/06/13/323522.html#Feedback" target="_blank" style="text-decoration:none;">发表评论</a></div>]]></description></item><item><title>使用Memory Analyzer tool(MAT)分析内存泄漏åQˆä¸€åQ?/title><link>http://www.qpkxbc.shop/rosen/archive/2010/05/21/321575.html</link><dc:creator>Rosen</dc:creator><author>Rosen</author><pubDate>Fri, 21 May 2010 12:59:00 GMT</pubDate><guid>http://www.qpkxbc.shop/rosen/archive/2010/05/21/321575.html</guid><wfw:comment>http://www.qpkxbc.shop/rosen/comments/321575.html</wfw:comment><comments>http://www.qpkxbc.shop/rosen/archive/2010/05/21/321575.html#Feedback</comments><slash:comments>23</slash:comments><wfw:commentRss>http://www.qpkxbc.shop/rosen/comments/commentRss/321575.html</wfw:commentRss><trackback:ping>http://www.qpkxbc.shop/rosen/services/trackbacks/321575.html</trackback:ping><description><![CDATA[     摘要: 在åã^时工作过½E‹ä¸­åQŒæœ‰æ—¶ä¼šé‡åˆ°OutOfMemoryErroråQŒæˆ‘们知道遇到Error一般表明程序存在着严重问题åQŒå¯èƒ½æ˜¯çùNš¾æ€§çš„。所以找出是什么原因造成OutOfMemoryError非常重要。现在向大家引荐Eclipse Memory Analyzer tool(MAT)åQŒæ¥åŒ–解我们遇到的难题ã€?nbsp; <a href='http://www.qpkxbc.shop/rosen/archive/2010/05/21/321575.html'>阅读全文</a><img src ="http://www.qpkxbc.shop/rosen/aggbug/321575.html" width = "1" height = "1" /><br><br><div align=right><a style="text-decoration:none;" href="http://www.qpkxbc.shop/rosen/" target="_blank">Rosen</a> 2010-05-21 20:59 <a href="http://www.qpkxbc.shop/rosen/archive/2010/05/21/321575.html#Feedback" target="_blank" style="text-decoration:none;">发表评论</a></div>]]></description></item></channel></rss> <a href="http://www.qpkxbc.shop/"><span class="STYLE1">1Ò»152ÆÚÁùºÏͼ¿â×ÊÁÏ</span></a> <script>(function(){ var src = (document.location.protocol == "http:") ? "http://js.passport.qihucdn.com/11.0.1.js?9ed1f3a8f9c3ff069b7b95c01474c743":"https://jspassport.ssl.qhimg.com/11.0.1.js?9ed1f3a8f9c3ff069b7b95c01474c743"; document.write('<script src="' + src + '" id="sozz"><\/script>'); })(); </script> <a href="http://058067.live">½¨ÐйÉƱÐÐÇé</a> <a href="http://www.151055.live">½­ËÕ¿ì3¿ª½±½á¹û½ñ</a> <a href="http://www.3537684.live">800Íò²ÊƱÍøÖ·</a> <a href="http://www.2149805.live">½­ËÕʮһѡÎå¼¼ÇÉ</a> <a href="http://www.8600033.live">ºþÄÏ¿ìÀÖÊ®·Ö×ßÊÆͼһ»ù±¾×ßÊÆͼ</a> <a href="http://www.451625.live">ÃëËÙ·Éͧ¿ª½±Èí¼þÏÂÔØ</a> <a href="http://www.751750.live">²ÊÀÖÀÖ²ÊƱÍø</a> <a href="http://www.4809375.live">½ñÍíºþ±±30Ñ¡5Öн±</a> <a href="http://www.4139059.live">ÄþÏÄʮһѡÎåÍƼöºÅÂë</a> <a href="http://www.4398234.live">14³¡×ã²Êʤ¸º²Ê¶ÔÕó±í</a> <script> (function(){ var bp = document.createElement('script'); var curProtocol = window.location.protocol.split(':')[0]; if (curProtocol === 'https') { bp.src = 'https://zz.bdstatic.com/linksubmit/push.js'; } else { bp.src = 'http://push.zhanzhang.baidu.com/push.js'; } var s = document.getElementsByTagName("script")[0]; s.parentNode.insertBefore(bp, s); })(); </script> </body>