Parquet.Net 1.4.0

.NET Standard 1.4 This package targets .NET Standard 1.4. The package is compatible with this framework or higher. .NET Framework 4.5.1 This package targets .NET Framework 4.5.1. The package is compatible with this framework or higher.
There is a newer version of this package available.
See the version list below for details. 
dotnet add package Parquet.Net --version 1.4.0                

                    
                

            
NuGet\Install-Package Parquet.Net -Version 1.4.0
This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package. 
<PackageReference Include="Parquet.Net" Version="1.4.0" />
For projects that support PackageReference, copy this XML node into the project file to reference the package. 
paket add Parquet.Net --version 1.4.0                

                    
                

            
#r "nuget: Parquet.Net, 1.4.0"
#r directive can be used in F# Interactive and Polyglot Notebooks. Copy this into the interactive tool or source code of the script to reference the package. 
// Install Parquet.Net as a Cake Addin
#addin nuget:?package=Parquet.Net&version=1.4.0

// Install Parquet.Net as a Cake Tool
#tool nuget:?package=Parquet.Net&version=1.4.0

A .NET library to read and write Apache Parquet files.

Product Compatible and additional computed target framework versions.
.NET net5.0 was computed.  net5.0-windows was computed.  net6.0 was computed.  net6.0-android was computed.  net6.0-ios was computed.  net6.0-maccatalyst was computed.  net6.0-macos was computed.  net6.0-tvos was computed.  net6.0-windows was computed.  net7.0 was computed.  net7.0-android was computed.  net7.0-ios was computed.  net7.0-maccatalyst was computed.  net7.0-macos was computed.  net7.0-tvos was computed.  net7.0-windows was computed.  net8.0 was computed.  net8.0-android was computed.  net8.0-browser was computed.  net8.0-ios was computed.  net8.0-maccatalyst was computed.  net8.0-macos was computed.  net8.0-tvos was computed.  net8.0-windows was computed. 
.NET Core netcoreapp1.0 was computed.  netcoreapp1.1 was computed.  netcoreapp2.0 was computed.  netcoreapp2.1 was computed.  netcoreapp2.2 was computed.  netcoreapp3.0 was computed.  netcoreapp3.1 was computed. 
.NET Standard netstandard1.4 is compatible.  netstandard1.5 was computed.  netstandard1.6 is compatible.  netstandard2.0 was computed.  netstandard2.1 was computed. 
.NET Framework net451 is compatible.  net452 was computed.  net46 was computed.  net461 was computed.  net462 was computed.  net463 was computed.  net47 was computed.  net471 was computed.  net472 was computed.  net48 was computed.  net481 was computed. 
MonoAndroid monoandroid was computed. 
MonoMac monomac was computed. 
MonoTouch monotouch was computed. 
Tizen tizen30 was computed.  tizen40 was computed.  tizen60 was computed. 
Universal Windows Platform uap was computed.  uap10.0 was computed. 
Xamarin.iOS xamarinios was computed. 
Xamarin.Mac xamarinmac was computed. 
Xamarin.TVOS xamarintvos was computed. 
Xamarin.WatchOS xamarinwatchos was computed. 
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.

NuGet packages (27)

Showing the top 5 NuGet packages that depend on Parquet.Net:

Package Downloads
ChoETL.Parquet

Parquet extension to Cinchoo ETL framework
Microsoft.DataPrep

Microsoft Azure Machine Learning Data Preparation SDK.
Komodo.Core

Komodo core libraries for crawling (file, object, web, database), parsing (JSON, XML, SQL, Sqlite, HTML, text), postings (inverted index, token extraction), indexing (search), metadata generation, and integrating within your application. Komodo is an information search, metadata, storage, and retrieval platform.
Microsoft.ML.Parquet

ML.NET components for Apache Parquet support.
PCAxis.Serializers

Paxiom serializers for formats like Excel, jsonstat, jsonstat2, sdmx

GitHub repositories (8)

Showing the top 5 popular GitHub repositories that depend on Parquet.Net:

Repository Stars
dotnet/machinelearning
ML.NET is an open source and cross-platform machine learning framework for .NET.
ravendb/ravendb
ACID Document Database
Cinchoo/ChoETL
ETL framework for .NET (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)
mukunku/ParquetViewer
Simple Windows desktop application for viewing & querying Apache Parquet files
compomics/ThermoRawFileParser
Thermo RAW file parser that runs on Linux/Mac and all other platforms that support Mono
Version Downloads Last updated
5.0.2 67 11/14/2024
5.0.2-pre.2 60 11/12/2024
5.0.2-pre.1 59 11/11/2024
5.0.1 36,103 10/14/2024
5.0.1-pre.1 539 10/3/2024
5.0.0 14,084 10/3/2024
5.0.0-pre.4 58 10/2/2024
5.0.0-pre.3 56 10/2/2024
5.0.0-pre.2 518 9/30/2024
5.0.0-pre.1 123 9/23/2024
4.25.0 77,919 9/9/2024
4.25.0-pre.3 130 9/6/2024
4.25.0-pre.2 2,266 6/11/2024
4.25.0-pre.1 97 6/7/2024
4.24.0 293,491 6/6/2024
4.24.0-pre.8 72 6/4/2024
4.24.0-pre.7 70 6/4/2024
4.24.0-pre.6 69 6/3/2024
4.24.0-pre.5 54 6/3/2024
4.24.0-pre.4 84 5/31/2024
4.24.0-pre.3 70 5/31/2024
4.24.0-pre.2 499 5/28/2024
4.24.0-pre.1 113 5/22/2024
4.23.5 222,391 4/4/2024
4.23.4 434,434 2/2/2024
4.23.3 19,807 1/25/2024
4.23.2 8,693 1/22/2024
4.23.1 6,732 1/19/2024
4.23.0 2,561 1/18/2024
4.22.1 8,530 1/17/2024
4.22.0 56,415 1/11/2024
4.20.1 4,805 1/10/2024
4.20.0 13,867 1/8/2024
4.19.0 23,233 1/5/2024
4.18.1 10,508 12/31/2023
4.18.0 23,404 12/22/2023
4.17.0 291,516 11/14/2023
4.16.4 510,921 9/11/2023
4.16.3 28,259 9/4/2023
4.16.2 96,082 8/22/2023
4.16.1 4,212 8/21/2023
4.16.0 2,601 8/17/2023
4.15.0 146,746 6/30/2023
4.14.0 28,352 6/28/2023
4.13.0 88,601 6/20/2023
4.12.0 132,898 5/22/2023
4.11.3 10,765 5/18/2023
4.11.2 50,303 5/16/2023
4.11.1 34,697 5/10/2023
4.11.0 4,914 5/9/2023
4.10.1 37,241 5/2/2023
4.10.0 30,837 4/26/2023
4.9.2 2,808 4/25/2023
4.9.1 3,421 4/21/2023
4.9.0 2,166 4/21/2023
4.8.1 10,566 4/19/2023
4.8.0 2,480 4/18/2023
4.8.0-alpha-00 1,553 4/17/2023
4.7.1 6,239 4/14/2023
4.7.0 7,378 4/13/2023
4.6.2 67,150 3/28/2023
4.6.1 5,563 3/23/2023
4.6.0 12,105 3/21/2023
4.5.4 323,733 2/23/2023
4.5.3 16,412 2/22/2023
4.5.2 10,940 2/20/2023
4.5.1 7,959 2/14/2023
4.5.0 7,368 2/13/2023
4.4.7 12,946 2/8/2023
4.4.6 47,866 1/31/2023
4.4.5 3,220 1/30/2023
4.4.4 2,529 1/27/2023
4.4.3 3,405 1/26/2023
4.4.2 1,726 1/26/2023
4.4.1 2,088 1/25/2023
4.4.0 3,116 1/24/2023
4.3.4 1,963 1/23/2023
4.3.3 2,146 1/20/2023
4.3.2 2,043 1/19/2023
4.3.1 1,682 1/19/2023
4.3.0 2,664 1/18/2023
4.2.3 6,594 1/16/2023
4.2.2 10,028 1/11/2023
4.2.1 7,397 1/10/2023
4.2.0 1,954 1/10/2023
4.1.3 64,647 12/21/2022
4.1.2 28,102 12/1/2022
4.1.1 117,369 11/10/2022
4.1.0 228,239 10/13/2022
4.0.2 10,497 10/12/2022
4.0.1 26,866 10/11/2022
4.0.0 56,985 9/22/2022
3.10.0 304,065 9/20/2022
3.9.1 1,534,635 10/14/2021
3.9.0 371,050 6/25/2021
3.8.6 457,760 3/5/2021
3.8.5 26,356 2/23/2021
3.8.4 271,419 12/13/2020
3.8.3 2,390 12/10/2020
3.8.2 1,939 12/10/2020
3.8.1 31,826 11/6/2020
3.8.0 4,313 11/6/2020
3.7.7 327,836 6/25/2020
3.7.6 25,656 6/16/2020
3.7.5 14,389 6/8/2020
3.7.4 187,610 5/19/2020
3.7.2 3,866 5/18/2020
3.7.1 48,736 4/21/2020
3.7.0 57,124 4/19/2020
3.6.0 5,437,069 1/23/2020
3.5.3 14,050 1/8/2020
3.5.2 3,518 1/3/2020
3.5.1 2,225 12/31/2019
3.5.0 9,652 12/18/2019
3.4.3 7,365 12/16/2019
3.4.2 3,768 12/13/2019
3.4.1 2,175 12/11/2019
3.4.0 2,987 12/11/2019
3.3.11 6,881 12/1/2019
3.3.10 48,706 11/6/2019
3.3.9 187,995 8/15/2019
3.3.8 8,772 8/1/2019
3.3.7 2,157 8/1/2019
3.3.6 2,271 7/31/2019
3.3.5 33,104 7/5/2019
3.3.4 184,296 3/11/2019
3.3.3 20,387 2/1/2019
3.3.2 26,456 1/21/2019
3.3.1 4,592 1/14/2019
3.3.0 3,706 1/11/2019
3.2.6 2,877 1/11/2019
3.2.5 4,540 1/3/2019
3.2.4 10,373 11/21/2018
3.2.3 50,940 11/7/2018
3.2.2 5,367 10/30/2018
3.2.1 2,461 10/30/2018
3.2.0 3,155 10/24/2018
3.1.4 2,493 10/15/2018
3.1.3 2,376 10/15/2018
3.1.2 46,851 10/11/2018
3.1.1 2,851 10/4/2018
3.1.0 2,796 10/3/2018
3.1.0-preview-390 2,069 10/3/2018
3.1.0-preview-373 2,329 10/2/2018
3.0.5 9,000 8/13/2018
3.0.4 2,525 7/25/2018
3.0.3 2,378 7/25/2018
3.0.2 2,829 7/24/2018
3.0.1 2,375 7/24/2018
3.0.0 3,321 7/19/2018
2.1.4 95,265 6/7/2018
2.1.3 260,677 3/30/2018
2.1.2 441,496 1/10/2018
2.1.1 116,350 12/1/2017
2.1.0 2,711 11/29/2017
2.0.1 2,513 11/27/2017
2.0.0 3,448 11/27/2017
1.5.1 3,330 11/14/2017
1.4.0 6,630 10/23/2017
1.3.0 5,346 9/12/2017
1.2.139 3,442 9/6/2017
1.1.128 3,313 8/15/2017
1.0.114 2,673 7/31/2017

v1.4

new features:
- data representation internally changed to columnar format, resulting in much smaller memory footprint and better performance (#238)
- added support for short/ushort CLR type (#235)
- breaking change: nullable columns are easier to define, parquet.net doesn't try to guess the nullability anymore and gives full control to the user

improvements:
- BigDecimal type supports much bigger numbers (scale and precision) (#239)
- Writer was failing on some forward-only streams like GZipStream as they don't track stream position, now parquet.net supports all kinds of non-seekable streams for write operations (#252)
- Decimal number format is now compatible with Impala (#243)

bug fixes
- Writer was failing on columns consisting of only null values (#222)
- When appending to file and using DateTime for one of your columns, subsequent appends would fail on schema validation (#247)
- Failure when deserialising Impala generated file with all nulls in a column (#240)
v1.3
new features:
- .NET byte and sbyte type is supported
- DataSet has got a new .Merge method that allows to merge two datasets, even if rows and columns are incompatible

improvements:
- we have removed a dependency on Snappy.Sharp completely which conflicted with projects targeting .NET 4.5
- dependency on System.ValueTuple is removed
- Apache Thrift dependency was replaced by a custom build which has zero downstream dependencies now. This was causing problems for projects using ASP.NET Core and specific Kestrel version, as stupidly enough Apache Thrift was referencing web hosting framework!

v1.2
new features:
- INT64 (C# long) type is supported (#194)
- Decimal datatype is fully supported (#209). This includes support for simple System.Decimal, and decimal types with different scales and precisions. Decimals are encoded by utilising all three encodings from parquet specs, however this can be switched off for compatibility with older system. Decimals are fully compatible with Hive and Impala which have some edge cases not complying with parquet specifications. Thanks to @dmitryPavliv and @nzapolski for making this possible

bugs fixed:
- fixed a flaw in dictionary encoding implementation affecting files written for AWS Impala (#193)
- when a column contains only single value and it's null Parquet.Net was crashing (#198)

v1.1
new features:
- Reader supports nested structures.
- Parquet output is now compatible with AWS Athena
- Writer can append data to existing file

improvements:
- Parquet metadata sets page sizes according to standard
- Schema and SchemaElement has Show method allowing to get user readable representation

bug fixes:
- some files mix encodings between data pages resulting in wrong count of rows and occasional crashes (#183)
- some string encoded fields not annotated properly were crashing Parquet.Net reader (#138)