Profile avatar
kylebarron.dev
Creating the next generation of geospatial data tools for Python & the browser with GeoArrow, GeoParquet & GeoRust @developmentseed | he/him 🌈
32 posts 582 followers 317 following
Prolific Poster
Conversation Starter

So awesome to see my amazing coworker @batpad.bsky.social having his work featured in the Museum of Modern Art here in NYC!!

🎉 The "Geocomputation with Python" book has been officially published today! Dive into the world of spatial analysis and geospatial data with Python. 📖🐍 Book's website: https://buff.ly/3NK2uBq #geocompx #geopython #spatialanalysis

New release of obstore: the simplest, highest-throughput Python interface to S3, GCS & Azure Storage! - Pickle support, to unblock usage in Dask and Zarr - Easier one-line store creation - Open remote objects as file-like readers or writers - Improved docs developmentseed.org/obstore/late...

Really cool to see @gadom.ski 's work integrating Rust-Python for the STAC ecosystem www.youtube.com/watch?v=FdCJ...

I didn't know anything about this -- Feb 11 there is a Rust NYC meetup feature DataFusion: www.meetup.com/rust-nyc/eve...

listen if you're interested in 🌍 geospatial companies or 💰 the existential weight of attempting to run a business or 👴🏻 my feelings on open source and realtime tech and stuff!

New obstore v0.3 for easy access to S3, GCS, and Azure Storage! - Easy **streaming** downloads, uploads, and copies across object stores via async iterators - Streaming list, with no pagination - Easier configuration with improved type hints - Fsspec integration developmentseed.org/obstore/late...

Really happy for myself and @developmentseed.org to be part of GeoJupyter, an initiative to improve interactive mapping and analysis in @projectjupyter.bsky.social notebooks. geojupyter.org/blog/2025010...

Occasionally that orange site (hn) digs up true gems. Today, an article documenting the development of my all-time fave video game, Railroad Tycoon II, published in 1998! Funny timing; over break I figured out how to install it on a Mac (and spent ~30 hrs playing it) www.filfre.net/2025/01/rail...

Thread with satellite imagery of the California wildfires.

Spatial indexes, and RTrees specifically, are at the core of geospatial software. But ever wondered how an RTree is actually implemented? In this post we’ll dive into the implementation of Flatbush, an elegant, blazing-fast, memory-efficient RTree. kylebarron.dev/literate-fla...

Releasing geo-index 0.2: Fast, memory-efficient, zero-copy spatial indexes (RTree & KDTree) for Python & Rust. - Range, nearest-neighbor queries - Persist indexes as bytes, reuse them later - Supports float32 for 2x less memory - Enables GeoParquet spatial partitioning github.com/kylebarron/g...

If you need a quick, but fairly deep introduction to GeoParquet -- I recommend you to listen to an episode of the MapScaping podcast with Kyle Barron. https://buff.ly/3D23bn7 #gischat #rspatial #geopython

Happy congestion pricing day!!

👇 TIL you can download "Apache Iceberg--The Definitive Guide" from O'Reilly for free. Based on reading the first chapter of it before losing my (paper) copy on an aircraft last year, I can recommend it 🤓.

github.com/apache/arrow... Xiangpeng is at it again. Another 10-15% end to end better performance by optimizing the lowest levels of Parquet decoding. This is the last trick I know of to squeeze performance out of parquet reading

Being 100% serious, for me what's described here is a big part of Rust's success. It's fun. And it makes things that are often un-fun (installing the toolchain, adding dependencies) easy.

Yet another impressive DataFusion Python release. This time with interoperability improvements with PyCapsule and FFI. datafusion.apache.org/blog/2024/12...

Moon – ciechanow.ski/moon/

Was a pleasure to be interviewed for the @cloudnativegeo.org blog! cloudnativegeo.org/blog/2024/12...

Here is job working on a data platform based on Apache DataFusion: rerun.io/careers?ashb...

Got the *most basic* proof of concept working for spatial support in DataFusion. Surprisingly easy to piece everything together

New #gischat post! This one following up as a practical Ibis/ @duckdb.org-powered exploration into a few of the spatial partitioning methods suggested in a recent GeoParquet discussion. Let me know what I missed! dewey.dunnington.ca/post/2024/pa...

Tonight was one of those nights… Basically everybody working on this Earth-system data thing was in the same room at the same time, sharing their best ideas. It was kind of magical. Thanks @developmentseed.org for co-hosting. ❤️ #AGU24

“Tools shape how we think about data, but as our understanding evolves, so must our tools”. 💯 yes. Looking forward to your thesis defense @manzt.sh!

Releasing a new Rust library to read and write Well-Known Binary geometries! - Really fast! No intermediate copying for either reading or writing. - Full support for Z, M, and ZM dimensions - Full support for little and big endian data - Read-only support for EWKB github.com/georust/wkb

Last week we published a new version of the Rust WKT crate, which sped up writing by up to 50%! And eases interoperability by adopting geo-traits! github.com/georust/wkt/...

First blog post in a long time! I started writing a post ~2 years ago on adventures counting 130M U.S. buildings by zipcode and finally circled back to write it up properly. @duckdb.org, Ibis, Apache Arrow, and GeoParquet were absolutely essential for the wrangling!

h3ronpy has been an enormous time-saver in building out the functionality of matching geometries with h3 hexagons on a recent project. If you use h3 in Python, consider using this binding instead!

I updated the h3-Arrow integration in h3ronpy, a fast, vectorized library for the h3 geospatial grid based in Rust. Check out the release notes: github.com/nmandery/h3r...

Love seeing Lonboard used for such good work!

I didn't see this already, so I went through my follow list and made a Starter Pack for Women+ in geo & EO - very broadly. I'm reminded how lopsided the gender divide is still in our field when I get 1 woman follower for every 10 men. It's particularly noticeable right now. go.bsky.app/Ay1iTTe

Great blog post on ways to get efficient Python user-defined functions in Apache DataFusion: datafusion.apache.org/blog/2024/11...