I'm playing with Kafka-Connect. I've got the HDFS connector working both in stand-alone mode and distributed mode.
They advertise that the workers (which are responsible for running the connectors) can be managed via YARN. However, I haven't seen any documentation that describes how to achieve this goal.
I don't know much about YARN either. How do I go about getting YARN to execute workers? If there is no specific approach, are there generic how-tos about how to get an application to run within YARN?
I already know what YARN is, I've used it with SPARK using spark-submit however I cannot figure out how to get the connector to run in YARN.
0 comments:
Post a Comment