Database Reference
In-Depth Information
org.apache.samza.config.factories.PropertiesConfigFactory
> --config-path=\
> file://$PWD/deploy/config/word-split.properties
$ ./deploy/bin/run-job.sh \
> --config-factory=\
>
org.apache.samza.config.factories.PropertiesConfigFactory
> --config-path=\
> file://$PWD/deploy/config/word-count.properties
Then check the
wikipedia-counts
topic for data to ensure the jobs are
running properly:
$ ./deploy/kafka/bin/kafka-console-consumer.sh \
> --zookeeper localhost:2181 --topic wikipedia-counts
Conclusion
This chapter introduced two frameworks for stream processing: the more
mature Storm framework and the newer Samza framework. Both
frameworks are fairly new and have a long way to go before they would be
considered to be complete frameworks. However, both can and are used to
build useful streaming applications today. Both can be adapted to fill nearly
any need and will become more complicated as they mature.
After the processing is done, it usually needs to be saved somewhere to
be useful. The next chapter covers storage options for these streaming
frameworks so that the data can be used by front-end applications for
visualization or other tasks.
