yao
  • 前言
  • Mac环境配置
    • 1.python配置
  • 部署安装
    • 博客blog文档md模板
    • linux安装python3
    • Docker部署
      • Compose-bigdatabase-单组件启动(docker)
      • Compose-Spark组件-单独启动(docker)
      • Docker-通过dockerfile构建镜像(需测试)
      • docker-yaosong5仓库dockerImages汇总
      • Docker基础镜像中-所有home配置
    • gp部署
      • tt
      • 命令和第二次搭建-ok
      • gp搭建遇到的错误
      • gp集群搭建①-下载greenplum
      • gp集群搭建②-新建用户免密登录
      • gp集群搭建③-greenplum系统搭建
  • 实际问题解决
    • kafka异常
    • 数仓-解决hive处理异常json命令行转义字符的问题
  • 数据分析
    • 数据分析总结-pandas
    • 数据分析总结-numpy
  • 应用环境
    • Docker环境启动流程
Powered by GitBook
On this page

Was this helpful?

  1. 实际问题解决

kafka异常

报错

INFO Replica loaded for partition consumer_offsets-13 with initial high watermark 0 (kafka.cluster.Replica) [2018-08-13 18:41:51,789] ERROR Error while creating log for consumer_offsets-13 in dir /usr/kafka/kafkalogs (kafka.server.LogDirFailureChannel) java.io.IOException: Invalid argument

at sun.nio.ch.FileChannelImpl.map0(Native Method)

打开zookeeper 查看

ls /

删除这些节点
rmr /cluster
rmr /brokers
rmr /isr_change_notification
rmr /log_dir_event_notification
rmr /controller_epoch
rmr /kafka-manager
rmr /consumers
rmr /latest_producer_id_block
rmr /config




rm -rf /Users/yaosong/Yao/DockerSource/sparkSource/kafkaall/kafka3/kafkalogs
rm -rf /Users/yaosong/Yao/DockerSource/sparkSource/kafkaall/kafka3/logs
rm -rf /Users/yaosong/Yao/DockerSource/sparkSource/kafkaall/kafka1/kafkalogs
rm -rf /Users/yaosong/Yao/DockerSource/sparkSource/kafkaall/kafka1/logs
rm -rf /Users/yaosong/Yao/DockerSource/sparkSource/kafkaall/kafka2/kafkalogs
rm -rf /Users/yaosong/Yao/DockerSource/sparkSource/kafkaall/kafka2/logs
Previous实际问题解决Next数仓-解决hive处理异常json命令行转义字符的问题

Last updated 6 years ago

Was this helpful?