Parquet.Net
5.0.2
.NET 6.0
This package targets .NET 6.0. The package is compatible with this framework or higher.
.NET Standard 2.0
This package targets .NET Standard 2.0. The package is compatible with this framework or higher.
dotnet add package Parquet.Net --version 5.0.2
NuGet\Install-Package Parquet.Net -Version 5.0.2
This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package.
<PackageReference Include="Parquet.Net" Version="5.0.2" />
For projects that support PackageReference, copy this XML node into the project file to reference the package.
paket add Parquet.Net --version 5.0.2
The NuGet Team does not provide support for this client. Please contact its maintainers for support.
#r "nuget: Parquet.Net, 5.0.2"
#r directive can be used in F# Interactive and Polyglot Notebooks. Copy this into the interactive tool or source code of the script to reference the package.
// Install Parquet.Net as a Cake Addin #addin nuget:?package=Parquet.Net&version=5.0.2 // Install Parquet.Net as a Cake Tool #tool nuget:?package=Parquet.Net&version=5.0.2
The NuGet Team does not provide support for this client. Please contact its maintainers for support.
Apache Parquet for .NET
Fully managed, safe, extremely fast .NET library to 📖read and ✍️write Apache Parquet files designed for .NET world (not a wrapper). Targets .NET 8, .NET 7, .NET 6.0, .NET Core 3.1, .NET Standard 2.1 and .NET Standard 2.0.
Whether you want to build apps for Linux, MacOS, Windows, iOS, Android, Tizen, Xbox, PS4, Raspberry Pi, Samsung TVs or much more, Parquet.Net has you covered.
Features at a glance
- 0️⃣ Has zero dependencies - pure library that just works anywhere .NET works i.e. desktops, servers, phones, watches and so on.
- 🚀Really fast. Faster than Python and Java, and alternative C# implementations out there. It's often even faster than native C++ implementations.
- 🏠NET native. Designed to utilise .NET and made for .NET developers, not the other way around.
- ❤️🩹Not a "wrapper" that forces you to fit in. It's the other way around - forces parquet to fit into .NET.
- 🦄Unique Features:
- The only library that supports dynamic schemas.
- Supports all parquet types, encodings and compressions.
- Fully supports C# class serialization, for all simple and complex Parquet types.
- Provides low-level, high-level, and untyped API.
- Access to file and column metadata.
- Integration with DataFrames (
Microsoft.Data.Analysis).
Links
UI
This repository now includes an implementation of parquet desktop viewer application called Floor (parquet floor, get it?). It's cross-platform, self-contained executable made with Avalonia, and is compiled for Linux, Windows and MacOS.
Floor is not meant to be the best parquet viewer on the planet, but just a reference implementation. There are probably better, more feature-rich applications out there.
Installing
Download it from the releases section. On Windows, you can install it with winget - winget install aloneguid.ParquetDotnet.floor.
Used by
- Azure Cosmos DB Desktop Data Migration Tool.
- RavenDB - An ACID NoSQL Document Database.
- Cinchoo ETL: An ETL framework for .NET.
- ParquetViewer: Simple Windows desktop application for viewing & querying Apache Parquet files.
- ML.NET: Machine Learning for .NET.
- PSParquet: PowerShell Module for Parquet.
- Omni Loader: Self-tuning Database Migration Accelerator.
- Contoso Data Generator V2 : sample data generator.
- Recfuence - An analysis of YouTube's political influence through recommendations.
- Kusto-loco - C# KQL query engine with flexible I/O layers and visualization.
- DeltaIO - Delta Lake implementation in pure .NET.
...raise a PR to appear here...
Contributing
See the contribution page. The first important thing you can do is simply star ⭐ this project.
| Product | Versions Compatible and additional computed target framework versions. |
|---|---|
| .NET | net5.0 was computed. net5.0-windows was computed. net6.0 is compatible. net6.0-android was computed. net6.0-ios was computed. net6.0-maccatalyst was computed. net6.0-macos was computed. net6.0-tvos was computed. net6.0-windows was computed. net7.0 was computed. net7.0-android was computed. net7.0-ios was computed. net7.0-maccatalyst was computed. net7.0-macos was computed. net7.0-tvos was computed. net7.0-windows was computed. net8.0 is compatible. net8.0-android was computed. net8.0-browser was computed. net8.0-ios was computed. net8.0-maccatalyst was computed. net8.0-macos was computed. net8.0-tvos was computed. net8.0-windows was computed. |
| .NET Core | netcoreapp2.0 was computed. netcoreapp2.1 was computed. netcoreapp2.2 was computed. netcoreapp3.0 was computed. netcoreapp3.1 was computed. |
| .NET Standard | netstandard2.0 is compatible. netstandard2.1 is compatible. |
| .NET Framework | net461 was computed. net462 was computed. net463 was computed. net47 was computed. net471 was computed. net472 was computed. net48 was computed. net481 was computed. |
| MonoAndroid | monoandroid was computed. |
| MonoMac | monomac was computed. |
| MonoTouch | monotouch was computed. |
| Tizen | tizen40 was computed. tizen60 was computed. |
| Xamarin.iOS | xamarinios was computed. |
| Xamarin.Mac | xamarinmac was computed. |
| Xamarin.TVOS | xamarintvos was computed. |
| Xamarin.WatchOS | xamarinwatchos was computed. |
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.
-
.NETStandard 2.0
- IronCompress (>= 1.6.3)
- Microsoft.IO.RecyclableMemoryStream (>= 3.0.1)
- Nullable (>= 1.3.1)
- System.Reflection.Emit.Lightweight (>= 4.7.0)
- System.Text.Json (>= 8.0.5)
- System.Threading.Tasks.Extensions (>= 4.5.4)
-
.NETStandard 2.1
- IronCompress (>= 1.6.3)
- Microsoft.IO.RecyclableMemoryStream (>= 3.0.1)
- System.Text.Json (>= 8.0.5)
-
net6.0
- IronCompress (>= 1.6.3)
- Microsoft.IO.RecyclableMemoryStream (>= 3.0.1)
-
net8.0
- IronCompress (>= 1.6.3)
- Microsoft.IO.RecyclableMemoryStream (>= 3.0.1)
NuGet packages (27)
Showing the top 5 NuGet packages that depend on Parquet.Net:
| Package | Downloads |
|---|---|
|
ChoETL.Parquet
Parquet extension to Cinchoo ETL framework |
|
|
Microsoft.DataPrep
Microsoft Azure Machine Learning Data Preparation SDK. |
|
|
Komodo.Core
Komodo core libraries for crawling (file, object, web, database), parsing (JSON, XML, SQL, Sqlite, HTML, text), postings (inverted index, token extraction), indexing (search), metadata generation, and integrating within your application. Komodo is an information search, metadata, storage, and retrieval platform. |
|
|
Microsoft.ML.Parquet
ML.NET components for Apache Parquet support. |
|
|
PCAxis.Serializers
Paxiom serializers for formats like Excel, jsonstat, jsonstat2, sdmx |
GitHub repositories (8)
Showing the top 5 popular GitHub repositories that depend on Parquet.Net:
| Repository | Stars |
|---|---|
|
dotnet/machinelearning
ML.NET is an open source and cross-platform machine learning framework for .NET.
|
|
|
ravendb/ravendb
ACID Document Database
|
|
|
Cinchoo/ChoETL
ETL framework for .NET (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)
|
|
|
mukunku/ParquetViewer
Simple Windows desktop application for viewing & querying Apache Parquet files
|
|
|
compomics/ThermoRawFileParser
Thermo RAW file parser that runs on Linux/Mac and all other platforms that support Mono
|
| Version | Downloads | Last updated |
|---|---|---|
| 5.0.2 | 67 | 11/14/2024 |
| 5.0.2-pre.2 | 60 | 11/12/2024 |
| 5.0.2-pre.1 | 59 | 11/11/2024 |
| 5.0.1 | 36,103 | 10/14/2024 |
| 5.0.1-pre.1 | 539 | 10/3/2024 |
| 5.0.0 | 14,084 | 10/3/2024 |
| 5.0.0-pre.4 | 58 | 10/2/2024 |
| 5.0.0-pre.3 | 56 | 10/2/2024 |
| 5.0.0-pre.2 | 518 | 9/30/2024 |
| 5.0.0-pre.1 | 123 | 9/23/2024 |
| 4.25.0 | 77,919 | 9/9/2024 |
| 4.25.0-pre.3 | 130 | 9/6/2024 |
| 4.25.0-pre.2 | 2,266 | 6/11/2024 |
| 4.25.0-pre.1 | 97 | 6/7/2024 |
| 4.24.0 | 293,491 | 6/6/2024 |
| 4.24.0-pre.8 | 72 | 6/4/2024 |
| 4.24.0-pre.7 | 70 | 6/4/2024 |
| 4.24.0-pre.6 | 69 | 6/3/2024 |
| 4.24.0-pre.5 | 54 | 6/3/2024 |
| 4.24.0-pre.4 | 84 | 5/31/2024 |
| 4.24.0-pre.3 | 70 | 5/31/2024 |
| 4.24.0-pre.2 | 499 | 5/28/2024 |
| 4.24.0-pre.1 | 113 | 5/22/2024 |
| 4.23.5 | 222,391 | 4/4/2024 |
| 4.23.4 | 434,434 | 2/2/2024 |
| 4.23.3 | 19,807 | 1/25/2024 |
| 4.23.2 | 8,693 | 1/22/2024 |
| 4.23.1 | 6,732 | 1/19/2024 |
| 4.23.0 | 2,561 | 1/18/2024 |
| 4.22.1 | 8,530 | 1/17/2024 |
| 4.22.0 | 56,415 | 1/11/2024 |
| 4.20.1 | 4,805 | 1/10/2024 |
| 4.20.0 | 13,867 | 1/8/2024 |
| 4.19.0 | 23,233 | 1/5/2024 |
| 4.18.1 | 10,508 | 12/31/2023 |
| 4.18.0 | 23,404 | 12/22/2023 |
| 4.17.0 | 291,516 | 11/14/2023 |
| 4.16.4 | 510,921 | 9/11/2023 |
| 4.16.3 | 28,259 | 9/4/2023 |
| 4.16.2 | 96,082 | 8/22/2023 |
| 4.16.1 | 4,212 | 8/21/2023 |
| 4.16.0 | 2,601 | 8/17/2023 |
| 4.15.0 | 146,746 | 6/30/2023 |
| 4.14.0 | 28,352 | 6/28/2023 |
| 4.13.0 | 88,601 | 6/20/2023 |
| 4.12.0 | 132,898 | 5/22/2023 |
| 4.11.3 | 10,765 | 5/18/2023 |
| 4.11.2 | 50,303 | 5/16/2023 |
| 4.11.1 | 34,697 | 5/10/2023 |
| 4.11.0 | 4,914 | 5/9/2023 |
| 4.10.1 | 37,241 | 5/2/2023 |
| 4.10.0 | 30,837 | 4/26/2023 |
| 4.9.2 | 2,808 | 4/25/2023 |
| 4.9.1 | 3,421 | 4/21/2023 |
| 4.9.0 | 2,166 | 4/21/2023 |
| 4.8.1 | 10,566 | 4/19/2023 |
| 4.8.0 | 2,480 | 4/18/2023 |
| 4.8.0-alpha-00 | 1,553 | 4/17/2023 |
| 4.7.1 | 6,239 | 4/14/2023 |
| 4.7.0 | 7,378 | 4/13/2023 |
| 4.6.2 | 67,150 | 3/28/2023 |
| 4.6.1 | 5,563 | 3/23/2023 |
| 4.6.0 | 12,105 | 3/21/2023 |
| 4.5.4 | 323,733 | 2/23/2023 |
| 4.5.3 | 16,412 | 2/22/2023 |
| 4.5.2 | 10,940 | 2/20/2023 |
| 4.5.1 | 7,959 | 2/14/2023 |
| 4.5.0 | 7,368 | 2/13/2023 |
| 4.4.7 | 12,946 | 2/8/2023 |
| 4.4.6 | 47,866 | 1/31/2023 |
| 4.4.5 | 3,220 | 1/30/2023 |
| 4.4.4 | 2,529 | 1/27/2023 |
| 4.4.3 | 3,405 | 1/26/2023 |
| 4.4.2 | 1,726 | 1/26/2023 |
| 4.4.1 | 2,088 | 1/25/2023 |
| 4.4.0 | 3,116 | 1/24/2023 |
| 4.3.4 | 1,963 | 1/23/2023 |
| 4.3.3 | 2,146 | 1/20/2023 |
| 4.3.2 | 2,043 | 1/19/2023 |
| 4.3.1 | 1,682 | 1/19/2023 |
| 4.3.0 | 2,664 | 1/18/2023 |
| 4.2.3 | 6,594 | 1/16/2023 |
| 4.2.2 | 10,028 | 1/11/2023 |
| 4.2.1 | 7,397 | 1/10/2023 |
| 4.2.0 | 1,954 | 1/10/2023 |
| 4.1.3 | 64,647 | 12/21/2022 |
| 4.1.2 | 28,102 | 12/1/2022 |
| 4.1.1 | 117,369 | 11/10/2022 |
| 4.1.0 | 228,239 | 10/13/2022 |
| 4.0.2 | 10,497 | 10/12/2022 |
| 4.0.1 | 26,866 | 10/11/2022 |
| 4.0.0 | 56,985 | 9/22/2022 |
| 3.10.0 | 304,065 | 9/20/2022 |
| 3.9.1 | 1,534,635 | 10/14/2021 |
| 3.9.0 | 371,050 | 6/25/2021 |
| 3.8.6 | 457,760 | 3/5/2021 |
| 3.8.5 | 26,356 | 2/23/2021 |
| 3.8.4 | 271,419 | 12/13/2020 |
| 3.8.3 | 2,390 | 12/10/2020 |
| 3.8.2 | 1,939 | 12/10/2020 |
| 3.8.1 | 31,826 | 11/6/2020 |
| 3.8.0 | 4,313 | 11/6/2020 |
| 3.7.7 | 327,836 | 6/25/2020 |
| 3.7.6 | 25,656 | 6/16/2020 |
| 3.7.5 | 14,389 | 6/8/2020 |
| 3.7.4 | 187,610 | 5/19/2020 |
| 3.7.2 | 3,866 | 5/18/2020 |
| 3.7.1 | 48,736 | 4/21/2020 |
| 3.7.0 | 57,124 | 4/19/2020 |
| 3.6.0 | 5,437,069 | 1/23/2020 |
| 3.5.3 | 14,050 | 1/8/2020 |
| 3.5.2 | 3,518 | 1/3/2020 |
| 3.5.1 | 2,225 | 12/31/2019 |
| 3.5.0 | 9,652 | 12/18/2019 |
| 3.4.3 | 7,365 | 12/16/2019 |
| 3.4.2 | 3,768 | 12/13/2019 |
| 3.4.1 | 2,175 | 12/11/2019 |
| 3.4.0 | 2,987 | 12/11/2019 |
| 3.3.11 | 6,881 | 12/1/2019 |
| 3.3.10 | 48,706 | 11/6/2019 |
| 3.3.9 | 187,995 | 8/15/2019 |
| 3.3.8 | 8,772 | 8/1/2019 |
| 3.3.7 | 2,157 | 8/1/2019 |
| 3.3.6 | 2,271 | 7/31/2019 |
| 3.3.5 | 33,104 | 7/5/2019 |
| 3.3.4 | 184,296 | 3/11/2019 |
| 3.3.3 | 20,387 | 2/1/2019 |
| 3.3.2 | 26,456 | 1/21/2019 |
| 3.3.1 | 4,592 | 1/14/2019 |
| 3.3.0 | 3,706 | 1/11/2019 |
| 3.2.6 | 2,877 | 1/11/2019 |
| 3.2.5 | 4,540 | 1/3/2019 |
| 3.2.4 | 10,373 | 11/21/2018 |
| 3.2.3 | 50,940 | 11/7/2018 |
| 3.2.2 | 5,367 | 10/30/2018 |
| 3.2.1 | 2,461 | 10/30/2018 |
| 3.2.0 | 3,155 | 10/24/2018 |
| 3.1.4 | 2,493 | 10/15/2018 |
| 3.1.3 | 2,376 | 10/15/2018 |
| 3.1.2 | 46,851 | 10/11/2018 |
| 3.1.1 | 2,851 | 10/4/2018 |
| 3.1.0 | 2,796 | 10/3/2018 |
| 3.1.0-preview-390 | 2,069 | 10/3/2018 |
| 3.1.0-preview-373 | 2,329 | 10/2/2018 |
| 3.0.5 | 9,000 | 8/13/2018 |
| 3.0.4 | 2,525 | 7/25/2018 |
| 3.0.3 | 2,378 | 7/25/2018 |
| 3.0.2 | 2,829 | 7/24/2018 |
| 3.0.1 | 2,375 | 7/24/2018 |
| 3.0.0 | 3,321 | 7/19/2018 |
| 2.1.4 | 95,265 | 6/7/2018 |
| 2.1.3 | 260,677 | 3/30/2018 |
| 2.1.2 | 441,496 | 1/10/2018 |
| 2.1.1 | 116,350 | 12/1/2017 |
| 2.1.0 | 2,711 | 11/29/2017 |
| 2.0.1 | 2,513 | 11/27/2017 |
| 2.0.0 | 3,448 | 11/27/2017 |
| 1.5.1 | 3,330 | 11/14/2017 |
| 1.4.0 | 6,630 | 10/23/2017 |
| 1.3.0 | 5,346 | 9/12/2017 |
| 1.2.139 | 3,442 | 9/6/2017 |
| 1.1.128 | 3,313 | 8/15/2017 |
| 1.0.114 | 2,673 | 7/31/2017 |