The multithreading preview for Crystal was just merged in yesterday so I’ve been playing around with it a bit to check its performance. Sure enough, I was able to saturate all 32 cores on a DigitalOcean droplet with 32.times { spawn { loop {} } }: [Crystal 32 cores] I wrote up a quick HTTP::Serve…

[image] straight-shoota: You could try with more and less threads to see if there is a better utilization ratio. To do that, run the program with an env var like CRYSTAL_WORKERS=8

[image] straight-shoota: You could try with more and less threads to see if there is a better utilization ratio. Tuning the thread pool was the first thing I tried. :-) I was using CRYSTAL_WORKERS=6 for these benchmarks, which is what allowed it to use up to 450-475% CPU. With the raw-string…

It would be interesting to compare to Go with fasthttp instead of standard net/http. Go with fasthttp can be much faster: [image] TechEmpower Web Framework Performance Comparison Performance comparison of a wide spectrum of web application frameworks and platforms using community-contrib…

[image] vlazar: It would be interesting to compare to Go with fasthttp instead of standard net/http . Feel free to try it out if you’re interested! You clearly know more about Go than I do. :smile: My own preference is to look at apps that are performing realistic workloads, which is why I s…

like talking to a DB Just note that crystal-db isn’t prepared for multithreading right now, but will soon be. So if you want to write a benchmark using that you’ll most likely get crashes or similar.

[image] Blog: Parallelism in Crystal Official A not so short post can be found at: https://crystal-lang.org/2019/09/06/parallelism-in-crystal.html If you want to have a conversation in the twitter land use

With the web requests one is it using 100% cpu’s?

It would be interesting to see the output from a sampling cpu profiler for those 100% cpu runs (i.e. “where is it using all that extra cpu” since I guess there’s theoretically 8 cores but it’s only 4x as fast… :) hmm…basically just out of curiosity…

Running a profiler on the original app I wrote for this thread (the one that yields the fiber and then serializes JSON) shows the event loop needs 12% of the CPU time available to that thread (1.55 seconds out of 12.82): [Thread trace for original app in macOS Instruments] Most of that is libeven…

Multithreaded Crystal initial thoughts

bcardiff September 6, 2019, 3:32pm 17

Topic		Replies	Views
[Help] Optimization and code review Learning Resources	13	648	August 15, 2021
Crystal multithreading support Crystal Contrib	40	3093	March 20, 2026
Timeline for multithreading support Crystal Contrib	31	2837	September 24, 2024
Crystal vs Go: Notes and Reflections Learning Resources	3	7799	March 3, 2021
1.0 multi-threading memory use issues Crystal Contrib	32	2105	August 29, 2020

Multithreaded Crystal initial thoughts

Related topics