Custom Code allows users to write Java code with data processing logic , upload Java jar packages to BladePipe, and BladePipe automatically call these codes during Full Data and Incremental to achieve various data transformation processing purposes.
- wide-table
- The fact table and dimension tables join processing code.
- data-transform
- General data transformation code, e.g., doing operation changes, adding additional fields, filter data,and so on.
- data-gather
- Aggregate sharding data code.e.g.,eliminate constraint conflicts, adding additional fields and so on.
- data-compare
- Verification and correction with business logic.
- business-alert
- Provides corresponding alarms based on stream data.
- Quick Start
- Create a Custom Code DataJob
- DataJob running.