How to delete a large number of documents in ES Posted on 2018-03-08 | Post modified | In ElasticSearch | | Visitors Words count in article 1361 | Reading time 6 es删除大量文档. Read more »
Build Kubernetes[k8s] cluster Posted on 2018-01-09 | Post modified | In Kubernetes | | Visitors Words count in article 1472 | Reading time 7 k8s集群搭建过程记录以及碰到的问题并给出解决方案。 Read more »
Exception that iptables failed from docker container Posted on 2017-12-27 | Post modified | In Docker | | Visitors Words count in article 274 | Reading time 1 docker容器启动异常 提示iptables failed:iptables --wait -t filter -A DOCKER Read more »
Spark performance optimization[repost] Posted on 2017-12-25 | Post modified | In Spark | | Visitors Words count in article 36 | Reading time 0 Spark性能调优。从四个方面着手:开发调优、资源调优、数据倾斜调优、shuffle调优.。开发调优和资源调优是所有Spark作业都需要注意和遵循的一些基本原则,是高性能Spark作业的基础;数据倾斜调优,主要讲解了一套完整的用来解决Spark作业数据倾斜的解决方案;shuffle调优,面向的是对Spark的原理有较深层次掌握和研究的同学,主要讲解了如何对Spark作业的shuffle运行过程以及细节进行调优。 Read more »
The overall implementation of SparkSQL framework[repost] Posted on 2017-12-14 | Post modified | In Spark , SparkSQL , | | Visitors Words count in article 146 | Reading time 0 SparkSQL的整体实现框架 Read more »
Spark RDD Posted on 2017-12-13 | Post modified | In Spark | | Visitors Words count in article 2922 | Reading time 14 常见RDD操作和比较 Read more »
Spark learning summary Posted on 2017-12-12 | Post modified | In Hadoop , Spark , | | Visitors Words count in article 711 | Reading time 3 spark核心概念理解 Read more »
Build hadoop & spark cluster Posted on 2017-12-11 | Post modified | In Hadoop , Spark , Zookeeper , | | Visitors Words count in article 4067 | Reading time 20 搭建hadoop&spark集群记录,ZK实现高可用 Read more »
Spark world count Posted on 2017-12-08 | Post modified | In Spark | | Visitors Words count in article 831 | Reading time 4 spark入门,计算文本中词频 Read more »
Spring 接口工具类 Posted on 2017-10-10 | Post modified | In Java , pring , | | Visitors Words count in article 367 | Reading time 1 该工具类目前用在两个地方,一是登录用户信息绑定在ThreadLocal线程,二是Spring容器与其他容器不兼容时,获取系统Bean实体或配置属性。通过这个工具类,让我更加钦佩Spring Framework的设计哲学,需踏踏实实地阅读源码。 Read more »