Skip to content

学习spark写的scala代码,工具使用的是IDEA2017.1.6,欢迎star

Notifications You must be signed in to change notification settings

shy1st/learningSpark

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

55 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

learningSpark

开发环境:

系统:Win10

开发工具:IntelliJ IDEA 2017.1.6 x64

项目管理工具:Apache Maven 3.5.0

JDK 1.8

Scala 2.11.12

Spark 2.1.0

HBase 1.1.5

Spark单机环境安装(cdh) https://blog.csdn.net/qq_35885488/article/details/103162749

spark在Idea中设置日志打印级别https://blog.csdn.net/qq_35885488/article/details/103201704

Spark Streaming处理Socket流简单实例 https://blog.csdn.net/qq_35885488/article/details/102667468

Spark Streaming处理文件(本地文件以及hdfs上面的文件) https://blog.csdn.net/qq_35885488/article/details/102681368

SparkStreaming 整合kafka实例 https://blog.csdn.net/qq_35885488/article/details/102695485

SparkStream整合hbase https://blog.csdn.net/qq_35885488/article/details/102717092

spark转换算子和行动算子介绍 https://blog.csdn.net/qq_35885488/article/details/102745211

spark rdd介绍 https://blog.csdn.net/qq_35885488/article/details/102723021

Spark中的匿名函数介绍 https://blog.csdn.net/qq_35885488/article/details/102617622

spark函数传递 https://blog.csdn.net/qq_35885488/article/details/102799923

sparkrdd连接mysql https://blog.csdn.net/qq_35885488/article/details/102813737

Spark无状态和有状态转化操作介绍 https://blog.csdn.net/qq_35885488/article/details/103185724

SparkStream连接mysql数据库 https://blog.csdn.net/qq_35885488/article/details/103197657

SparkStream窗口函数 https://blog.csdn.net/qq_35885488/article/details/103199008

sparkStream之黑名单过滤 https://blog.csdn.net/qq_35885488/article/details/103201803

sparkStreaming整合Flume的两种方式 https://blog.csdn.net/qq_35885488/article/details/103252180

About

学习spark写的scala代码,工具使用的是IDEA2017.1.6,欢迎star

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Scala 93.6%
  • Java 6.4%