Convert

Converts event data between formats.

Configuration

- convert:
    name: to_arrow
    target_format: arrow

Fields

FieldTypeDefaultDescription
namestringrequiredTask name.
target_formatstringavroTarget format: avro, json, arrow.
schemastring/resourceOptional schema for the conversion.
depends_onlistUpstream task names.
retryobjectRetry configuration.

Example

- convert:
    name: json_to_arrow
    target_format: arrow
    schema:
      resource: schemas/orders.json