Hi, I’d like to check that I am not missing something before I start writing some code to work around this problem. I have a Process, which I have connect to via a pipe, and which outputs JSON objects one at a time in response to it’s input. I had originally hoped that I would be able to wrap the …

I had to do something similar for oq where I wanted the generation of the JSON and parsing to happen concurrently. For that I did something like: require "json" channel = Channel(Bool | Exception).new reader, writer = IO.pipe spawn do writer.puts "[99" sleep 2 writer.puts ",100" writer.pu…

Thank you for your reply, that is very interesting. However, if I understand correctly, you still need to close the writer channel before pull.read_end_array will return, which in my case is not really possible because the process that is generating the output is a long running process: I want it t…

[image] 2f1cafc: I want it to continue running and to keep the pipe open, but I want to take action whenever it completely outputs an object. You may run into an issue here given JSON::PullParser assumes there’s only one top level object to parse. Was some discussion/workarounds to this in Ne…

I recently needed this also. In my case reading ndjson from a stream. bcardiff/icrystal/blob/master/src/ndjson.cr require "json" module JSON # Same as JSON::Parser but only calls next_token at the beginning of .parse # This allows us to parse multiple JSON objects from a single…

Brilliant, thank you for sharing, that’s really useful!

Progressively reading JSON from a JSON::PullParser

Help & Support

Blacksmoke16 February 24, 2024, 4:01pm 4

You may run into an issue here given JSON::PullParser assumes there’s only one top level object to parse. Was some discussion/workarounds to this in Newline-delimited JSON.

Topic		Replies	Views
Newline-delimited JSON Help & Support	14	748	December 27, 2025
How to marshall/access data from within JSON::PullParser Help & Support	1	330	November 30, 2021
Let JSON::PullParser#on_key work with nested keys Crystal Contrib	6	512	July 13, 2024
Iterators and JSON Crystal Contrib	20	789	February 18, 2021
Performance issues with the JSON parser Help & Support	24	1162	March 21, 2024

Progressively reading JSON from a JSON::PullParser

Related topics