Convert avro schema to string. public class AvroConverter{. nio. string: unicode character sequence. map(new RichMapFunction<Map<String, Object>, GenericRecord>() {. Just like below: Avro Converter is created for supporting data conversion and serialization based on Apache Avro technology. Example: Deserializing Json Schema to Json String or Object. public class Event extends org. I want to convert JSON Data to Avro schema. val schemaObj = new Schema. All that is needed is to specify the VALUE_FORMAT as protobuf, and the conversion will happen automatically. You can use the tool to convert between Avro Schema and other schema formats like JSON Schema, XML Schema (XSD), Protocol Buffers (Protobuf), ASN. com Avrotize is a command-line tool for converting data structure definitions between different schema formats, using Apache Avro Schema as the integration schema model. Looking for a Jar or Python code that can create JSON -> Avro schema. If you are viewing in Nifi, then you should check if the you embedded the schema or not. My input data : {"redeliveredDataEventIndices":"[]"} I know this is a duplicate of How to fix Expected start-union. FileInfo(path); var json = AvroConvert. js is an option, you can use avsc to do the conversion for you. Mar 30, 2017 · The JSON to Avro conversion performed in NiFi's ConvertJSONToAvro processor does not really do transformation in the same step. from fastavro import writer, reader, schema from rec_avro import to_rec_avro_destructive, from_rec_avro_destructive, rec_avro_schema def json_objects(): return [{'a': 'a'}, {'b':'b'}] # For efficiency, to_rec_avro_destructive() destroys rec, and reuses it's # data structures to construct avro_objects avroObjects = (to_rec_avro Oct 20, 2015 · If using node. loads (' {"a":"b"}') For more information take a look at this Avro Python Guide. Instead, you should do a JSON-to-JSON Aug 13, 2021 · One would need a consistent structure for the dataframe. I would like to parse it with the following avro schema: Feb 12, 2022 · Avro Converter. ReadNext(); // process item } } Jul 13, 2017 · NiFi detects a field as being a Date or Timestamp by looking at the schema type and logicalType annotations, according to the Avro schema standard. lastName Jul 16, 2019 · 1 Answer. Parameters: avroSchema - (undocumented) Returns: (undocumented) Since: 2. Oct 25, 2018 · // Parse Body of AVRO file // 1. It seems to be working at least. 8. Long and the convertor's class is java. My code is as follows: Is the Avro SpecificRecord (i. 8. If that's the case, and the conversion from the Json built-in format to Avro built-in format fails, the field will fall back to a string. Apr 1, 2020 · It is a Scala librarie, I foud nothing in java. format. For example, the name field of our User schema is the primitive type string, whereas the favorite_number and favorite_color fields are both unions, represented by JSON arrays. It is also smaller in size because it does not have closing tags. I need a genric record out of the same string, as the JSON data holds the values as well. Use this deserializer with GenericRecord , types generated using the avrogen. Apr 29, 2021 · The alternative is to build a new POJO model, but it would effectively be the same class definition as building a SpecificRecord from the schema, so maybe look at using Jackson Avro Objectmapper instead of plain Avro API Aug 19, 2021 · I have problems converting the bytes fields to String. Jun 28, 2018 · The AVRO schema is used for ordering of fields without a header in the CSV formatted files. GetSchema(byte[] avroObject) Deserialization of large collection of Avro objects one by one. Ignored thirst byte and get id of schema to find right schema. import org. * * @param schema The schema of the generic type. jar tojson --schema-file reader. SpecificRecord { } In my test file, I have a sample string: Mar 30, 2021 · So I'm trying to read a JSON file that I send via HTTP POST to an Event Hub that captures the data and converts it to an Avro file format in an Azure Blob Storage, now I'd like to download that file again and convert it back to a JSON format using Python. specific. lang. send(new ProducerRecord[String,GenericRecord](topic,key,results. Below is the method definition. It generate java class source code User from schema record User . Add your JSON data and automatically convert it to Avro Schema. I want to encode User to byte[] , and decode byte[] to User . avsc) of the json file. I need to find a way to ingest the data and Schema such that it will allow for nullable records to be untyped in the JSON-string. I use schema registry and id. UnrecognizedOptionException: 'schema-file' is not a recognized option I'm looking primarily for a command line instruction because I'm not so confortable writing Java code, but I'd be happy with Java code to compile myself. Successfully parsed a JSON object from input but failed to convert into a Record object with the given schema Jul 21, 2020 · I have been able to debug the issue down to point where avro native code is trying to convert the value and the problem is it is assigning the convertor based on class of the field. It is a simple format that is easier to comprehend than XML. Jul 26, 2021 · In addition to the "normal" binary encoding, the JSON encoding is also part of Avro's specification but there just don't seem to be as many examples of it around. foreach { tuple =>. Schema avroSchema) Converts an Avro schema to a corresponding Spark SQL schema. Jul 17, 2020 · This auto generated POJO contains below extra field among others (apart from the one specified by the user in the Avro schema) public static final org. Calling clone with wrapUnions set will automatically wrap values into the first union branch they match. I am getting this exception. I would prefer not to have both the JSON defined and the C# model. class and add @EnableSchemaRegistry. . Add your data to get started. For example, the expected schema of one column is of "enum" type, instead of "string" type in the default converted schema. Nullable; public class ReflectedCustomer { private String firstName; private String lastName; @Nullable private String nickName; // needed by the reflection public ReflectedCustomer(){} public ReflectedCustomer(String firstName, String lastName, String nickName) { this. FromResult(buffer. avsc. Reuse Avro object from the existing Event-Based systems for defining RESTful interface. I want to convert json schema to avro schema using python because I'm building my microservice in Python Fastapi. But what if we wanted something like from_avro which grabbed the bytes from some column in the row and also grabbed the string representation of the Avro schema from some other column in the row, and then parsed that Avro into a JSON string. ToArray()); Here TData is a model which can be serialised to Json. Mar 19, 2024 · Update the schema to make the field nullable . We are using it with node-avro-io 0. dataType. I am working on converting huge xml files to avro format, and as a part of this I will have to use the XSD schema to generate Avro file schema - using Python (preferably). avro4s. Dec 5, 2021 · Now, lets use avro-tools to convert this to Avro format $ java -jar avro-tools-1. cast("string")). Using Avro GenericDatumReader to read it as Generic Record. Why do we need serializer instead of just dumping into JSON? validation that your data matches the schema. @me_ Write a model class, deserialize the JSON to it, then pass it to this shown function. If the converted output Avro schema is of record type, the record name is topLevelRecord and there is no namespace by default. toString()) // Read parsed string in JSON format val data = spark. Parse(string) taken from open source projects. Here is a simple example on how to use it. Sep 30, 2020 · 3 years, 5 months ago. Input a URL. Then I tried to serialize such objects to json by ObjectMapper, but always got a JsonMappingException saying "not an enum" or "not a union". Is there any way to convert AsyncAPI yaml file to an Avro schema file? here is my AsyncAPI file Jul 24, 2020 · 0. vladkrava</ groupId > /**Creates a ParquetWriterFactory that accepts and writes Avro generic types. public static SchemaConverters. object Main extends App {. Choose a file. Aug 25, 2018 · Avro and POJO conversions (tips for Kafka devs) I want to share with you a few useful code snippets while working with Avro schema/message. But when your schema gets more complicated it becomes very cumbersome to work with it. 2. g. class=io. Sep 6, 2016 · Viewed 21k times. Use map function of RDD to convert each element in list to Sting format val bodyRDD = df. datafile import DataFileReader, DataFileWriter from avro. Schema SCHEMA$; Due to some bug in Avro API the Schema. Apache Avro is an open-source framework for serializing and transporting data described by schemas. Got VALUE_NUMBER_INT The Avro utility works well if the JSON is generated by the Avro library because it adds the type and union information to it. < dependency > < groupId >com. Aug 25, 2020 · Where are you viewing the data ? Is it in Nifi? Avro is in binary format so its not readable in any editor. However, the other problem is that getweatherdata () returns a single dictionary so when you do avro_objects = (to_rec_avro_destructive (rec) for rec in getweatherdata ()) you are iterating over AvroJsonSerializer serializes data into a JSON format using AVRO schema. If the schema is embedded then something in the flow is wrong. In this case, I can define a global XSD schema, and use this transform. The only exception is that the null type is never registered in Schema Registry. In this article, you will learn how to use from_avro () and to_avro () with You can use the avro-tools to convert the json file({input_file}. Mar 8, 2023 · Avro4s. the generated java classes) compatible with schema evolution? I. . I used avro-tools to generate java classes from avsc files, using: java. Avro binary encoding. Apache Avro is an open-source, row-based, data serialization and data exchange framework for Hadoop projects, originally developed by databricks as an open-source library that supports reading and writing data in Avro file format. JavaConversions. In java, you should use a RichMapFunction to convert DataStream to DataStream and add a transient Schema field to generate GenericRecord. jar fromjson test. When I try to convert the using Avro utility, I get the following exception, Expected start-union. My schema is : Jan 23, 2023 · Unable to convert JSON String to Avro Schema using Kite-data-core. Unions. But i dont know how to do this in scala, just for reference. By voting up you can indicate which examples are most useful and appropriate. json(bodyRDD) Nov 5, 2020 · you can try with fastavro and rec_avro module, here's some example. The type to which the value of the current AvroDecimal should be converted. bytes: sequence of 8-bit unsigned bytes. _. map(obj=>{. I have events which contain properties. 0. This parses an avro schema, not a serialized avro document. import glob from avro_to_python_types import typed_dict_from_schema_file schema_files = glob. 4. ToJson(fileInfo); Jul 23, 2019 · It iterates over strings and adds the values in a tuple. read, write and function from_avro: 2. InvalidAvroMagicException: Not an Avro data file. Schema); writer. Jul 1, 2020 · loaded_json = [from_rec_avro_destructive(rec) for rec in reader(f_in)] To convert a JSON string to json objects use json. Aug 9, 2019 · I want to convert xml to json based on the avro schema rather than the using xsd. case class Propertie(name: String, value: String) case class Event(name: String Oct 4, 2017 · But how to create AVRO Schema based on it? Looking for programatic way to do that since will have many schemas and can not create Avro Schema manually every time. If I had to maintian one, I would prefer to have a C# model. Without a schema, the record value is a Map and with a schema it becomes a struct. read. Schema schema = JsonUtil. My goal is to obtain the same avro schema by converting the AsyncApi schema yaml. collection. I suppose, you were trying to read the avro file with the given schema. json. sksamuel. Serializing Apache Avro Objects via REST API and Other Transformations. May 1, 2016 · Maybe something as follows, I used the following code to write to a Kineses Stream. Jan 20, 2016 · I ran the avro-tools jar to create the java file to represent the schema. With Java I can use Avro Tools from Apache to convert the file to JSON: java -jar avro-tools-1. avsc record. avro Exception in thread "main" joptsimple. That produced the property that looks like: public java. if I have a source of Avro messages (in my case, kafka) and I want to deserialize those messages to a specificrecord, is it possible to do safely? What I see: adding a field to the end of a schema works fine - can deserialize ok to specificrecord Feb 4, 2020 · Got VALUE_STRING. What I want to do is: create the class object (message to be sent) save it to the database in a human readable format such as json; then retrieve it from the database and send it to kafka; This is an anonymised example of my schema. io. 0: recordName: topLevelRecord Jul 12, 2019 · Hey i am new to Avro Schema space, needed to convert Jason Array into Avro Schema. Avro Schema The input and output content of the flow files should be Avro data files. * The Parquet writers will use the given schema to build and write the columnar data. IO. , favorite_number can either be an int or null, essentially making it an optional field. Below Jason is kind of client which serviceName along-with enabler- If Enabler is true means that particular service is taken by client If Enabler is false means that particular service is not taken by client. public static GenericRecord convertToGenericRecord(String schemaPath, SomeClass someObject){. avro Now, lets see how the file has been generated: As mentioned in one of the answers, you probably want to use response. (Note that when a default value is specified for a record field whose type is a union, the type of the default value must match the first element of the union. inferSchema(JsonUtil. Input format. You can juste annotate you application. Here's the class I'm serializing : private Date date; private SimpleDateFormat df = new SimpleDateFormat("dd/MM/yyyy hh:mm:ss. Jan 19, 2022 · I have a JSON String that needs to be serialized to AVRO format so that I can publish that to a Kafka topic that has an Avro schema with schema validation on it. json) to avro file({output_file}. To fix the processor, you need to update the source topic schema to mark the tags field nullable. The sink property format. Oct 10, 2022 · To reiterate, what I'm trying to do is package incoming JSON-formatted data (string, byte array, node, whatever) with an Avro Schema to create GenericRecords which will be output to . If I understand right, the best way to handle the situation is to realize that the message was written with v1 of "mySchema", get the v1 schema using a schema registry, and deserialize the message using v1. toSqlType(avroSchema). Primitive type names are also defined type names. How do I convert a BigDecimal value to the expected ByteBuffer as I create an Dec 31, 2020 · The KafkaConnect custom transformer only needs to add a schema to the incoming JSON. jar tojson --pretty inputfile > output. Apache Maven. s3. I had to modify my code as below: @Override. Below is what I have tried so far b Sep 8, 2019 · I write a sample with avro library. 0 and stream-to-arry 2. Drop a file or click to select a file. See Supported types for Spark SQL -> Avro conversion. When writing Avro, this option can be set if the expected output Avro schema doesn't match the schema converted by Spark. I suspect the 2nd attempt fails because it's writing json to the avro format, looking at GenericDatumWriter the conversion is to write the base type (this is the same thing the avro-tools do when dumping data. In the final Avro schema, these Avro logical type fields will be a union of the logical type and string. I finally remembered to ask the Kafka mailing list and got the following as an answer, which worked perfectly. But it won't coerce a complex structure to a string. public Schema Jun 4, 2022 · Two steps to convert any pojo class to avro genric record. Primitive types have no specified attributes. import scala. Unions, as mentioned above, are represented using JSON arrays. parse(new File(avscfilepath)); var sparkSchema : StructType = new StructType. string schemaInJsonFormat = AvroConvert. Schema. ByteArrayOutputStream. This means that the "type" and "logicalType" must be valid Avro, even if the data is another type. In the end I send the data to a topic: The results variable is a String but I added "asInstanceOf". Avro2Json(avroObject); Full Documentation. Above proposed solutions work perfectly fine for scenarios where one instance of an AVRO object needs to be sent back or received. confluent. map(x=>x(0). Jan 14, 2023 · In Spark, avro-module is an external module and needed to add this module when processing Avro file and this avro-module provides function to_avro () to encode DataFrame column value to Avro binary format, and from_avro () to decode Avro binary data into a string value. toString (); final ParquetBuilder<GenericRecord> builder Conversion of Avro to JSON directly; var resultJson = AvroConvert. Assuming that you are using the confluent-dot-net client, you can use AvroDeserializer: (async) Avro deserializer. Since the class is java. An System. Begin); return Task. Dec 21, 2017 · Let's insert the Schema Generator processor just before the Local FS destination and give the schema a suitable name: Notice that the Schema Generator processor puts the schema in a header Here's an example of how you can convert a JSON string to Avro using the avro-python3 library: python from avro import io from avro import schema from avro. For example, consider the TIMESTAMP field in our use case. Thus, for example, the schema "string" is equivalent to: {"type": "string"} May 5, 2016 · Convert XSD (XML Schema) to AVSC (Avro Schema) using Python. avsc") for schema_file in schema_files: types Sep 4, 2021 · Is there any way to convert JSON data directly to Avro schema in C# and asp. avro"; var fileInfo = new System. The Avro file is a file generated by the Archive feature in Microsoft Azure Event Hubs. For this, I'll define a global AVRO schema. public async Task RecordAsync(ISpecificRecord record, string partitionKey) { using (var ms = new MemoryStream()) { var encoder = new BinaryEncoder(ms); var writer = new SpecificDefaultWriter(record. json --schema-file test. 1). unions are a complex type that can be any of the types listed in the array; e. glob("schemas/*. There is no direct translation. I am currently getting some data in csv format that has one field which is a string encoding of a JSON array like such: With millions of lines per file, I'll want to use only Record-based processors. something like this: rdd. reflect. avro files. I want to avoid reading data as AVRO from kafka as I am reading data from different topics with different Schemas in same kafka. Instant it doesn't get matched. Parser(). JavaScript Object Notation (JSON), pronounced as Jason, is the most common data interchange format on the web. Avro Converter will help you to: Convert Avro object into most popular data formats such as JSON, XML and CSV. Object instance of type conversionType conversionType whose value is equivalent Mar 11, 2019 · Convert string field to JSON array or Avro Array in Nifi record. Select Body column in Binary Format // 2. For example, Apache Nifi, converts XML to JSON or AVRO using AVRO schema. net core API. if your schema is simple you can probably just do a simple map. For example, ["null", "string"] declares a schema which may be either a null or string. time. History. The processor includes support for the following basic type conversions: Anything to String, using the data’s default String representation. Related Work. json Apr 19, 2021 · Let's say I used avro-tools to generate code for v2 of "mySchema", and a message comes on a queue that was written with v1 of "mySchema". 3". So we set ourselves the task of making the REST APIs accept Json and convert the Json into the Avro generated object. 930"} Jan 8, 2017 · Converts the numeric value of the current AvroDecimal to a given type. SchemaType toSqlType(org. 2 and 1. e. What is Apache Avro. exe -jar avro-tools-1. json () rather than response. Navigate to iot_2 topic, and then on the schema tab. Jan 26, 2018 · I would like to know what the proper avro schema would be for some json to avro conversion that is in this format: {"entryDate": "2018-01-26T12:00:40. SSS"); public Dummy() {. io import DatumReader, DatumWriter import json def convert_json_to_avro(json_str, avro_schema): # Load the JSON data json_data = json Dec 30, 2019 · I'm getting JSON string as an input, I converted the Json string to avro schema using this. See full list on baeldung. jar compile -string schema myfile. 1, and database schema formats When sending a message to a topic t, the Avro schema for the key and the value will be automatically registered in Schema Registry under the subject t-key and t-value, respectively, if the compatibility test passes. Using jackson/avro, to convert the pojo into bytes with Avro Mapper. getElementType() method causes Not an array Exception during serialization. Seek(0, SeekOrigin. An T:System. It can be simplified though: the loops are useless since having more than one object would result in invalid JSON. DataStream<GenericRecord> records = maps. select(col("Body"). Exception in thread "main" org. */ public static ParquetWriterFactory<GenericRecord> forGenericRecord(Schema schema) { final String schemaString = schema. From the Actions options, choose edit schema, and paste the following content for the value. HasNext()) { var item = reader. Instead use message payload to retrive class and get schema to convert byte array to final avro schema. In my test I create the generated object Jan 14, 2022 · This library does one thing, it converts Avro schemas to python types. 1. firstName = firstName; this. There is a very limited ability to transform based on the Avro schema, mostly omitting input data fields in the output. ByteBuffer currency; Elsewhere in my code, I will be working with currency values in BigDecimal types. offset. Avro defines two data formats relevant to the connector: Avro schema. Apache Avro ships with some very advanced and efficient tools for reading and writing binary Avro but their support for JSON to Avro conversion is unfortunately limited and requires wrapping fields with type declarations if you have some optional fields in your schema. If not, i suppose it can look the way it shows you. Take a look on example from Avro documentation: Take a look on example from Avro documentation: Aug 23, 2018 · The problem with the first attempt is that the LogicalType information never leaves the schema, the GenericRecord just sees a long. Yes, you can send messages as byte arrays. rdd. Viewed 2k times. serialization of unions (see SimpleExample below) some Avro JSON deserializers expect fields in JSON in the same order as in the schema. Conversion to and from optional Avro types Oct 4, 2016 · I can't find a way to deserialize an Apache Avro file with C#. connect. Oct 9, 2023 · I have a java quarkus application with an avro schema containing a union of objects. Example of Avro Data Serialization: import java. OpenDeserializer<CustomClass>(new MemoryStream ( avroObject))) { while ( reader. For more information on Apache Avro, see the Apache Avro Documentation. 15. Installing. I cannot find any valid resources for this conversion. Aug 13, 2017 · To be able to set Avro field to null you should allow this in Avro schema, by adding null as one of the possible types of the field. Set the following properties to ensure that you’re reading from the beginning of the stream: SET 'auto. Write(record, encoder); // AWS Kineses var putRecordRequest = new PutRecordRequest { StreamName The mapping from Spark SQL type to Avro schema is not one-to-one. Douglas Crockford first released the JSON specification in the early 2000s. parse(jsonString), "schema"); I have the avro schema which I can register in schema registry. Upload a file. Integrate Avro with Spring MVC. To register with schema registry the schema needs to be in a JSON AVRO format (Just like Schema above). avro) when you know the schema({schema_file}. What is missing however, would be a solution allowing to send/receive collections or arrays of same AVRO objects. avro. package example. reset' = 'earliest'; To convert the events to Protobuf, we’re going to create a derived stream. Let's say if i have ReflectedCustomer class in java. JsonToAvroConverter. double: double precision (64-bit) IEEE 754 floating-point number. 10. Nov 27, 2019 · With the move to Avro we wanted to ensure we would not require a Java class definition and an Avro schema, as this would result in two definitions that could easily get out of sync with each other. apache. AvroFormat will take care of the rest. If the default output schema of to_avro matches the schema of the target subject, you can do the Dec 28, 2022 · I simply using schema registry. Jan 30, 2018 · The data is being transformed into bytes using logical Avro data types within ExecuteSQL processor, converting avro to Json using ConvertAvrotoJSON processor, and then using ConvertJsonToAvro processor to put into HDFS using PutParquet. Aug 20, 2016 · In order to convert the Avro schema I used spark-avro like so: SchemaConverters. Flatten objects. Add library: libraryDependencies += "com. The rationale is that the incoming Json objects may contain invalid Json built-in formats. jar' but that can not create Avro Schema from JSON directly. On my current project, we heavily utilize Avro schemas and Avro messages, it is relatively easy to use and manipulate. : Reason: I only want to maintain C# models and automatically register these models with Confluent's Schema Registry. 7 I have used schemaconverter from Databricks. avsc > test. String types to numeric types int, long, double, and float. I checked 'avro-tools-1. avro4s" %% "avro4s-core" % "1. Ask Question Asked 1 year, 2 months ago. exe tool or one of the following primitive types: int, long, float, double, boolean, string, byte []. But, XSD schema is very complicated for me. Avro is an excellent choice due to message compression mechanisms and Schema Registry support especially for whose who are using Event-Driven architecture with Apache Kafka as an event distribution platform. ) Dec 24, 2019 · buffer. json. AvroConvertOnline - online Avro Schema to C# model converter - Library containing functionalities, which enable communication between microservices via Http using Avro data format Simply install its package from NuGet by entering Install-Package AvroConverter on the Package Manager command line (or your CLI if not using Visual Studio), then call it with the following from your code: var path = @"C:\your\avro\file\path. Dec 25, 2017 · $ java -jar avro-tools-1. it is mostly used in Apache Spark especially for Kafka-based data pipelines. text so that you get back an actual JSON dictionary. AvroSchema. Got VALUE_NUMBER_INT when converting JSON to Avro on the command line? but how to give input for the type array (redeliveredDataEventIndices is array of type int in this case) java. 1 day ago · 1. asInstanceOf[GenericRecord])) Here is my iterator: iterator. Serialization using the avro4s library, that have the feature to generate a schema and a record (GenericRecord) given a case class. public void setDate(Date date) {. IFormatProvider interface implementation that supplies culture-specific formatting information. Jun 11, 2012 · I'm actually trying to serialize objects containing dates with Avro, and the deserialized date doesn't match the expected value (tested with avro 1. Does such built-in method exist? Mar 3, 2021 · I have the Avro Schema and its generated class. Viewed 375 times Here are the examples of the csharp api class Avro. result. toSqlType. import com. Cast the Cody Column as String // 3. The data is a string with the value Dec 19, 2016 · I have an auto-generated avro schema java class. Nov 15, 2022 · While converting the input flow file JSON to any other format using query record (CSVwriter or AVRO Writer) using inferschema strategy the NIFI processor is trying to convert to Date based on first few characters of the incoming string. Read schema from Avro object. To get up and running quickly, you can use this to simply load schemas and print out the python code that is generated. Data types are also determined by the AVRO schema and used to convert CSV String data to their respective data type. Your signature Function it's look like this. Avro is not a "self describing" format like JSON is. The kafka documentation is written in AsyncAPI. Oct 14, 2019 · I am converting the my String to byte array using getBytes() and passing it to this function. Modified 12 months ago. Output format. SpecificRecordBase implements org. using (var reader = AvroConvert. Dec 7, 2023 · I have uploaded this avro schema to confluent schema registry and the messagevalidation is working fine. 7. While I have tried several solutions yet, none of them successfully converted the ByteArray to an 'human readable' String. asInstanceOf[StructType] The convertion of the RDD was more tricky. val (keyinfo, info, Worked(outinfo May 5, 2017 · Here is an example of what we are doing for a similar use case where we send Avro records to another queue (Amazon Kinesis), adapted to your schema. wq ul rh fy fl xb fg gc af pz
June 6, 2023