tubeshowcase●1,673,749 videos♡ My collection 0
← Learn to Code

Learn to Code42:16

Java, How Fast Can You Parse 1 Billion Rows of Weather Data? • Roy van Rijn • GOTO 2024

GOTO Conferences ↗

From the creator

This presentation was recorded at GOTO Amsterdam 2024. #GOTOcon #GOTOams https://gotoams.nl Roy van Rijn - Experienced Developer & Architect, Robotics Enthusiast & Hobby Mathematician @royvanrijn ORIGINAL TALK TITLE How Fast Can You Parse a File with 1 Billion Rows of Weather Data Using Java? RESOURCES https://x.com/royvanrijn https://www.linkedin.com/in/royvanrijn https://github.com/royvanrijn https://royvanrijn.com Links https://adventofcode.com https://x.com/gunnarmorling https://www.morling.dev ABSTRACT Last January a challenge was posted online by Gunnar Morling: How fast can you parse a file with 1 billion rows of weather data using Java? Little did I know this deceivingly simple question would lead me down a path that taught me all about: parallelism, memory mapped files, SWAR techniques (SIMD as a register), bit twiddling, branchless code, mechanical sympathy, Graal native compilation and finally... I even turned to the dark side: using sun.misc.Unsafe. Join me in this deep dive where I'll explain all the code changes and tricks that took me from the reference implementation which processes the billion records in 4+ minutes, to processing everything in under 2 seconds. Who knew Java could be this fast? [...] TIMECODES 00:00 Intro 01:49 The challenge 06:07 Watch, learn, adopt, experiment 08:00 Mechanical sympathy 09:32 Temperature as integer 10:37 Memory mapped files 11:54 Getting unsafe 13:31 SWAR 17:22 Stringless 18:18 Branchless programming 20:35 Parse the

Published 2024-07-12 · Watch on YouTube ↗
Availability and playback restrictions are controlled by the original channel.

Keep exploring Learn to Code