You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi
I would like to test writing data as Avro instead of parquet
I've configured Secor to write Avro file
After some time I get and the process is stopped
java.lang.RuntimeException: Failed to apply upload policy
at com.pinterest.secor.consumer.Consumer.checkUploadPolicy(Consumer.java:198)
at com.pinterest.secor.consumer.Consumer.run(Consumer.java:179)
Caused by: java.util.NoSuchElementException
at org.apache.avro.file.DataFileStream.next(DataFileStream.java:249)
at org.apache.avro.file.DataFileStream.next(DataFileStream.java:235)
at com.pinterest.secor.io.impl.AvroFileReaderWriterFactory$AvroFileReader.next(AvroFileReaderWriterFactory.java:101)
at com.pinterest.secor.uploader.Uploader.trim(Uploader.java:228)
at com.pinterest.secor.uploader.Uploader.trimFiles(Uploader.java:272)
at com.pinterest.secor.uploader.Uploader.checkTopicPartition(Uploader.java:335)
at com.pinterest.secor.uploader.Uploader.applyPolicy(Uploader.java:363)
at com.pinterest.secor.consumer.Consumer.checkUploadPolicy(Consumer.java:196)
meaning the reader try to read the record in the file and it's empty
Triggered by public D next(D reuse) throws IOException { if (!hasNext()) throw new NoSuchElementException(); D result = reader.read(reuse, datumIn); if (0 == --blockRemaining) { blockFinished(); } return result; }
Any help thanks
The text was updated successfully, but these errors were encountered:
Hi
I would like to test writing data as Avro instead of parquet
I've configured Secor to write Avro file
After some time I get and the process is stopped
meaning the reader try to read the record in the file and it's empty
Triggered by
public D next(D reuse) throws IOException { if (!hasNext()) throw new NoSuchElementException(); D result = reader.read(reuse, datumIn); if (0 == --blockRemaining) { blockFinished(); } return result; }
Any help thanks
The text was updated successfully, but these errors were encountered: