Monday, September 10, 2018

Open source C# .NET libraries for reading and writing Parquet files

We're starting to extensively use Parquet files. There are a couple of open source .NET libraries available for reading and writing Parquet files. I thought it might be worth sharing in case any people here also work with Parquet files.

ParquetSharp (https://github.com/G-Research/ParquetSharp)

Our library, implemented as a C# wrapper around Apache's C++ Parquet library (https://github.com/apache/parquet-cpp). It's very fast and exposes a lot of low-level methods if needed. Should work on multiple platforms but currently the nuget only provides Windows x64 binaries for the moment.

Parquet.NET (https://github.com/elastacloud/parquet-dotnet)

Elastacloud Parquet library fully implemented in managed .NET. It's smaller, more portable, and has commercial support, but is slower and does not expose all the lower-level details of the Parquet file format.

Happy to hear your feedback and thoughts.

Enjoy!

Open source C# .NET libraries for reading and writing Parquet files Click here
  • Blogger Comment
  • Facebook Comment

0 comments:

Post a Comment

The webdev Team