mspark 블로그

$mvn avro:help [INFO] Scanning for projects... [INFO] [INFO] --------------------------< com.mspark:kafka >-------------------------- [INFO] Building kafka 0.0.1-SNAPSHOT [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] --- avro-maven-plugin:1.9.1:help (default-cli) @ kafka --- [INFO] Apache Avro Maven Plugin 1.9.1   Maven plugin for Avro IDL and Specific API Compilers This plugin has 5 goals: avro:help   Display help information on avro-maven-plugin.   Call mvn avro:help -Ddetail=true -Dgoal=<goal-name> to display parameter   details. avro:idl-protocol   Generate Java classes and interfaces from AvroIDL files (.avdl) avro:induce   Generate Avro files (.avsc and .avpr) from Java classes or interfaces avro:protocol   Generate Java classes and interfaces from Avro protocol files (.avpr) avro:schema   Generate Java classes from Avro schema files (.avsc) avro:induc...

brew tap AdoptOpenJDK/openjdk brew cask install adoptopenjdk8

centos 기반으로 설치를 진행 했으나 아래의 단점이 발견 되어 docker-compose로 로컬 환경을 구축 하였음 단점  - 설치가 귀찮다  - docker 시작시 zookeeper나 kafka 기동이 귀찮다.  - 깜박하고 container에 port 오픈을 안했다.... 아래의 사이트를 참고하여 docker-compose 구성 https://miiingo.tistory.com/196 docker-compose.yaml version: '2' networks: test: services: zookeeper: image: wurstmeister/zookeeper:3.4.6 container_name: zookeeper ports: - "2181:2181" networks: - test kafka: image: wurstmeister/kafka:2.12-2.4.1 container_name: kafka environment: KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://localhost:9092 KAFKA_LISTENERS: PLAINTEXT://0.0.0.0:9092 KAFKA_ADVERTISED_HOST_NAME: 127.0.0.1 KAFKA_ADVERTISED_PORT: 9092 KAFKA_ZOOKEEPER_CONNECT: zookeeper:2181 KAFKA_CREATE_TOPICS: "test:1:1" # Topic명:Partition개수:Replica개수 volumes: - /var/run/docker.sock:/var/run/docker.sock ports: - "9092:9092" depends_on: - zookeep...