OT-FilterUserData (3)

[frlzjosh]

WHAT TO DO:

1. When requesting data from the user microservice, there will be instances that we won't need to get users that already exist in the UserReport DB. This task requires you to only request users that do not exist in your database already.
2. Look into Kafka Streams or Kafka Observables for this task, so that we can filter the users we need on the fly right when consuming the user data.

RESOURCES:
(KAFKA-OBSERVABLES)

1. https://github.com/ghermeto/kafka-observable
2. https://www.linkedin.com/pulse/nodejs-kafka-easy-peasy-observables-guilherme-hermeto/
3. https://www.npmjs.com/package/kafka-observable
   (KAFKA-STREAMS)
4. https://www.npmjs.com/package/kafka-streams
5. https://github.com/nodefluent/kafka-streams/blob/master/docs/quick-start.md

DONE:

1. You are able to request users from the user microservice, and will only persist the users that don't exist in the UserReport DB.