Incremental Partition Scheduling for MapReduce Skew-Avoiding

来源 :第七届国际博士生论坛暨青年教师发展研讨会 | 被引量 : 0次 | 上传用户:caolippp123456
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
  MapReduce consisting of map and reduce functions,as a flexible computation model has been wildly used in processing the scale of terabytes or higher data sets in a distributed cluster,such as access log analysis,document clustering and other forms of data analytic.Skew,tasks exhibit large variance in size or processing cost,is a common MapReduce performance problem,caused by the user specify or default partition function in processing intensive data.
其他文献
  除了商业属性的SAS与SPSS之外,R语言(R-Project)己是各国统计专业人士最常使用的统计分析语言及软件。尽管如此,由于核心程序代码的限制,R软件仅能加载小于硬件内存大小
会议
  滴水湖位于上海市浦东新区临港新城内,面积为5.56km2,是大型城市人工景观湖泊,也是临港新城的核心与象征.自2006 年至2013 年,在滴水湖湖区设置8 个采样点,每月中旬对浮
  The rapid growth in the volume of many real-world graphs(e.g.,social networks,web graphs,and spatial networks)has led to the development of various vertex-c
会议
本研究参照美国临床和实验室标准化研究所(CLSI)相关标准,采用药敏纸片方法,分别对分离自食品中的19株阪崎肠杆菌进行包括头孢唑啉、头孢噻吩、头孢哌酮、头孢曲松、头孢呋辛钠、头孢吡肟、庆大霉素、妥布霉素、氨曲南、氨苄西林、环丙沙星、氯霉素、四环素、苯唑西林、哌拉西林、美洛培南在内的共16种常规抗生素药敏检测。实验结果表明,19株阪崎肠杆菌对苯唑西林以及头孢噻吩的耐药率分别为100%和78.95%,
  Thin provisioning is widely used to improve the utilization ratio of storage space in the storage area network(SAN)environment.However,most of file systems
会议
金纳米棒(GNR)因其各向异性结构和独特的光谱特征而倍受研究者青睐,得到飞速的发展,广泛应用于金属离子和氨基酸检测、免疫分析、癌细胞成像和光热治疗以及纳米材料组装等领域
  In this paper,an interesting fusion method,named as NNSP,is developed for infrared and visible image fusion,where non-negative sparse representation is used
会议
在前期研究中,利用差减杂交技术对孤雌与正常胚胎发育相关联的基因的分析,我们发现了差异表达的基因Ypel3。该基因位于小鼠7号染色体qF3区域内,包含5个外显子,mRNA全长为1 05
  When using plenoptic camera for digital refocusing,angular undersampling can cause severe(angular)aliasing artifacts.Previous approaches have focused on avo
会议
  We present light and scanning electron microscopy on two new species of Prestauroneis from the Zoigê Wetland,Sichuan Province,China.Prestauroneis nenwai sp
会议