Pybigdata Save
使用 python 操作大数据的各种组件
Project README
pybigdata
做大数据应用需要学习什么编程语言，一定要学 java 吗，不，python 也是一个很好的选择
所以，一起用 python 来玩转大数据吧
install
pip install -r requirements.txt
pip install --no-deps thrift-sasl==0.2.1
list
| 大数据组件 | python 操作示例 | 文档 |
|---|---|---|
| hadoop | ctrl_hdfs.py | hdfs |
| hadoop-mapreduce | mapreduce | mapreduce.md |
| hive | ctrl_hive.py 一进一出 udf 多进一出 udaf 一进多出 udtf |
impyla |
| impala | ctrl_impala.py | impyla |
| hbase | ctrl_hbase.py | happybase |
| kafka | demo_producer.py demo_consumer.py |
kafka |
| elasticsearch | ctrl_elasticsearch.py | elasticsearch |
| spark | demo_spark.py | pyspark |
| flink | flink-sql | flink 实践系列2-flinksql |
| doris | ctrl_doris | DorisClient |
Open Source Agenda is not affiliated with "Pybigdata" Project. README Source: TurboWay/pybigdata
Stars
62
Open Issues
3
Last Commit
1 year ago
Repository
License
Open Source Agenda Badge
