Yann Collet
0f984d94c4
changed MT enabling macro to ZSTD_MULTITHREAD
2017-01-19 14:05:07 -08:00
Yann Collet
f22adae984
fixed minor warning (unused variable) in fuzzer
2017-01-19 13:46:30 -08:00
Yann Collet
736788f8e8
added streaming fuzzer tests for MT API
...
Also : fixed corner case, where nb of jobs completed becomes > jobQueueSize
which is possible when many flushes are issued
while there is not enough dst buffer to flush completed ones.
2017-01-19 12:15:29 -08:00
Przemyslaw Skibinski
8a0bc30a2d
Merge remote-tracking branch 'refs/remotes/facebook/dev' into dev11
2017-01-17 13:02:29 +01:00
Przemyslaw Skibinski
d72f4b6b7a
added "Makefile is validated"
2017-01-17 12:40:06 +01:00
Yann Collet
5eb749e734
ZSTDMT_compress() creates a single frame
...
The new strategy involves cutting frame at block level.
The result is a single frame, preserving ZSTD_getDecompressedSize()
As a consequence, bench can now make a full round-trip,
since the result is compatible with ZSTD_decompress().
This strategy will not make it possible to decode the frame with multiple threads
since the exact cut between independent blocks is not known.
MT decoding needs further discussions.
2017-01-11 18:21:25 +01:00
Nick Terrell
c220d4c74d
Use COVER_MEMMULT when training with COVER.
2017-01-09 16:49:04 -08:00
Yann Collet
56958500fc
minor man page update
2017-01-09 19:47:09 +01:00
Nick Terrell
3a1fefcf00
Simplify COVER parameters
2017-01-02 17:51:38 -08:00
Nick Terrell
df8415c502
Add COVER to the zstd cli
2017-01-02 14:43:08 -08:00
Yann Collet
6334b04d61
compile object files, for faster recompilation
2017-01-02 03:22:18 +01:00
Yann Collet
747452677d
fixed cmake tests
2017-01-02 02:05:45 +01:00
Yann Collet
cdb2763f4a
new Makefile target zstdmt
2017-01-02 01:43:56 +01:00
Yann Collet
f1cb55192c
fixed linux warnings
2017-01-02 01:11:55 +01:00
Yann Collet
0ec6a95ba1
minor fixes
2017-01-02 00:49:42 +01:00
Yann Collet
c6a6417458
bench correctly measures time for multi-threaded compression (posix only)
2016-12-31 03:31:26 +01:00
Yann Collet
f765a375a5
Merge pull request #504 from terrelln/thread-pool
...
[zstdmt] Add thread pool
2016-12-30 15:31:49 +01:00
Yann Collet
e70912c72b
Changed : input divided into roughly equal parts.
...
Debug : can measure time waiting for mutexes to unlock.
2016-12-29 01:24:01 +01:00
Yann Collet
8d7432914f
Merge pull request #503 from inikep/dev11
...
Dev11
2016-12-28 16:50:39 +01:00
Yann Collet
ab7a579180
added -T command , to set nb of threads
2016-12-28 16:11:09 +01:00
Przemyslaw Skibinski
75f3a3a335
changed default PREFIX and MANDIR
2016-12-28 12:32:41 +01:00
Yann Collet
3d93f2fce7
first zstdmt sketch
2016-12-27 07:19:36 +01:00
Yann Collet
c07d2e3a31
Merge pull request #499 from inikep/dev11
...
improved *BSD and Solaris compatibility
2016-12-23 21:32:03 +01:00
Przemyslaw Skibinski
63b0014b96
BSD: improved "make install"
2016-12-23 10:05:49 +01:00
Andrew Janke
fce374a100
zstdless: add shebang and quote $@
2016-12-22 17:40:10 -05:00
Przemyslaw Skibinski
b999170311
Solaris: working "make -C lib install"
2016-12-22 20:14:37 +01:00
Przemyslaw Skibinski
aab442133d
Solaris: working "make -C programs install"
2016-12-22 19:26:01 +01:00
Yann Collet
8333106b8a
Merge branch 'dev' of github.com:facebook/zstd into dev
2016-12-21 16:44:24 +01:00
Yann Collet
0d7e84899f
Merge pull request #489 from inikep/v112
...
improved detection of POSIX
2016-12-21 16:42:46 +01:00
Yann Collet
9518744025
Merge branch 'dev' of github.com:facebook/zstd into dev
2016-12-21 16:20:41 +01:00
Yann Collet
1f57c2ed32
added : ZSTD_createCDict_byReference()
2016-12-21 16:20:11 +01:00
Przemyslaw Skibinski
7a8a03c20d
util.h: restore BSD license for Facebook Open-Source
2016-12-21 15:08:44 +01:00
Przemyslaw Skibinski
97a258d71d
updated comments
2016-12-21 14:00:41 +01:00
Przemyslaw Skibinski
e679741b18
_CRT_SECURE_NO_WARNINGS moved to util.h
2016-12-21 13:47:11 +01:00
Przemyslaw Skibinski
2f6ccee6af
platform.h: removed Compiler Options
2016-12-21 13:23:34 +01:00
Przemyslaw Skibinski
101df4f636
fixed Visual Studio compilation
2016-12-21 11:43:11 +01:00
Przemyslaw Skibinski
a35b9448ac
improved MinGW support
2016-12-21 11:18:45 +01:00
Przemyslaw Skibinski
5736db219e
fix basic types redefinition
2016-12-21 09:26:00 +01:00
Przemyslaw Skibinski
20b089e53d
simplified zstdcli.c
2016-12-21 09:19:15 +01:00
Przemyslaw Skibinski
16ae6563a2
executables use new util.h and platform.h
2016-12-21 09:06:14 +01:00
Przemyslaw Skibinski
ead350bdc0
improved util.h and platform.h
2016-12-21 09:04:59 +01:00
Przemyslaw Skibinski
1c1db6b845
windres updated to v1.1.3
2016-12-20 11:21:26 +01:00
Przemyslaw Skibinski
f8046b8e72
Merge remote-tracking branch 'refs/remotes/facebook/dev' into v112
...
# Conflicts:
# appveyor.yml
2016-12-19 08:20:26 +01:00
Yann Collet
1496c3dc47
Fix : size estimation when some samples are very large
2016-12-18 11:58:23 +01:00
Yann Collet
d46ecb58a5
added dll compilation tests
2016-12-17 16:28:12 +01:00
Przemyslaw Skibinski
0b37205098
util.h: minor improvement
2016-12-16 17:12:23 +01:00
Przemyslaw Skibinski
b0f3663edc
imporved support for POSIX-type OSes
2016-12-16 15:41:18 +01:00
Przemyslaw Skibinski
3cdfe266cf
use PLATFORM_POSIX_VERSION
2016-12-16 15:00:50 +01:00
Przemyslaw Skibinski
b0e670a054
util.h uses platform.h
2016-12-16 14:25:12 +01:00
Przemyslaw Skibinski
b866e72826
tools use platform.h
2016-12-16 14:24:01 +01:00
Przemyslaw Skibinski
b3843afcf5
introduced platform.h
2016-12-16 14:13:15 +01:00
Przemyslaw Skibinski
25314428c9
zstd.1: added advanced compression options
2016-12-14 16:10:13 +01:00
Przemyslaw Skibinski
c71e552b2e
fixed "strategy" in advanced compression parameters
2016-12-13 20:04:32 +01:00
Przemyslaw Skibinski
98ef0f98df
fixed conversion warning
2016-12-13 14:52:21 +01:00
Przemyslaw Skibinski
8349d675e0
fileio.c: support advanced compression parameters
2016-12-13 13:24:59 +01:00
Przemyslaw Skibinski
897b8bb5eb
bench.c: support advanced compression parameters
2016-12-13 13:03:41 +01:00
Przemyslaw Skibinski
334b8962b0
Merge remote-tracking branch 'refs/remotes/facebook/dev' into dev11
2016-12-13 12:19:19 +01:00
Przemyslaw Skibinski
671f28d1e5
added parseCompressionParameters
2016-12-13 12:18:07 +01:00
Dimitry Andric
83cc2fb083
Enable using isatty() and nanosleep() on *BSD
2016-12-12 19:24:51 +01:00
Yann Collet
4c6ce5a57e
Merge pull request #476 from inikep/dev11
...
Dev11
2016-12-12 16:44:55 +01:00
Przemyslaw Skibinski
c855da7533
allow all operationg systems with _POSIX_C_SOURCE >= 200112L
2016-12-12 15:37:43 +01:00
Przemyslaw Skibinski
242c036875
turn on the '-r' option for HP-UX and AIX
2016-12-12 11:59:17 +01:00
Przemyslaw Skibinski
c01ac6c30a
turn on the '-r' option for *BSD and Solaris
2016-12-12 11:23:21 +01:00
Yann Collet
fda539f50b
minor coding style changes
2016-12-12 01:03:23 +01:00
Przemyslaw Skibinski
128acb35db
improved MSYS support
2016-12-08 10:49:59 +01:00
Przemyslaw Skibinski
13de72e0cc
programs\Makefile: use Linux paths
2016-12-08 10:43:55 +01:00
Yann Collet
2a826e592b
compatibility with zstd-frugal (noBench mode)
2016-12-06 17:56:20 -08:00
Yann Collet
e63c631aaf
decode benchmark, multi-files
2016-12-06 17:46:49 -08:00
Yann Collet
d946501d2c
decode benchmark - single file (hidden option)
2016-12-06 16:49:23 -08:00
Yann Collet
6b9a983261
changed gzstd build messages
2016-12-06 11:23:25 -08:00
Przemyslaw Skibinski
7c6bbc3298
updated FIO_passThrough
2016-12-05 18:31:14 +01:00
Przemyslaw Skibinski
6b508b1770
updated test-gzstd
2016-12-05 18:02:40 +01:00
Przemyslaw Skibinski
b493e3b3d3
introduced srcBufferLoaded
2016-12-05 17:39:38 +01:00
Przemyslaw Skibinski
3c69760275
improved FIO_decompressGzFrame
2016-12-05 15:58:23 +01:00
Przemyslaw Skibinski
8489f184f6
improved detection of -lz
2016-12-05 13:47:00 +01:00
Yann Collet
db85a6e09a
added zstdgrep
2016-12-02 15:57:07 -08:00
Yann Collet
efaf104b2d
added zstdless
2016-12-02 15:24:40 -08:00
Yann Collet
743b33f57e
fix zstdcat
2016-12-02 15:18:57 -08:00
Yann Collet
5bd4237beb
minor refactor
2016-12-02 12:40:57 -08:00
Przemyslaw Skibinski
690753ea1a
improved formatting in FIO_decompressSrcFile
2016-12-02 16:20:16 +01:00
Przemyslaw Skibinski
4e49580407
removed testing artifacts
2016-12-02 15:19:00 +01:00
Przemyslaw Skibinski
c5eebca128
rewritten FIO_decompressGzFile
2016-12-02 15:01:31 +01:00
Przemyslaw Skibinski
b0f2ef2119
improved gzip_* functions
2016-12-02 13:50:29 +01:00
Przemyslaw Skibinski
4b504f131a
added gzip_open, gzip_close, gzip_read
2016-12-02 13:11:39 +01:00
Przemyslaw Skibinski
daaf754539
detect stream with ungetc
2016-12-01 13:29:19 +01:00
Przemyslaw Skibinski
19aad42ee1
added FIO_decompressGzFile
2016-12-01 11:56:31 +01:00
Przemyslaw Skibinski
166830ed0a
autodetect -lz
2016-11-30 16:43:07 +01:00
Przemyslaw Skibinski
abfb51f5f2
gzstd: decompresses .gz files
2016-11-30 15:05:54 +01:00
Przemyslaw Skibinski
0e14675df2
fileio.c: detect .gz files
2016-11-30 13:34:21 +01:00
Yann Collet
167c494748
Merge branch 'dev' of github.com:facebook/zstd into dev
2016-11-29 14:05:15 -08:00
Yann Collet
4f5350f610
long matches support overflow
2016-11-29 13:12:24 -08:00
Przemyslaw Skibinski
fd0ac93024
bench.c: use ZSTD_maxCLevel()
2016-11-23 21:45:29 +01:00
Przemyslaw Skibinski
5ddcd9d9ae
bench.c: fixed MAX_CLEVEL
2016-11-21 16:37:56 +01:00
Przemyslaw Skibinski
5a17223691
Merge remote-tracking branch 'refs/remotes/facebook/dev' into dev11
2016-11-18 11:47:01 +01:00
Przemyslaw Skibinski
2558b4cdbc
bench.c without dict uses ZSTD_compressCCtx
2016-11-18 11:46:30 +01:00
Przemyslaw Skibinski
3d18088b38
updated windres
2016-11-17 18:04:41 +01:00
Yann Collet
52afb3993e
zbuff API now generates deprecation warnings
2016-11-16 08:50:54 -08:00
Yann Collet
cdff19c4b3
minor comment change
2016-11-11 17:26:54 -08:00
Yann Collet
0018ca28dc
zstd cli : displays total decoded size, even when a stream consists of multiple frames
2016-11-07 14:42:37 -08:00
Przemyslaw Skibinski
d0815583d9
Changed stdinmark and stdoutmark
2016-11-04 11:37:27 +01:00
Przemyslaw Skibinski
38b590ad69
Merge remote-tracking branch 'refs/remotes/facebook/dev' into dev11
...
# Conflicts:
# lib/Makefile
2016-11-04 10:10:54 +01:00
Yann Collet
407a11f63e
fixed Visual compatibility
2016-11-03 15:52:01 -07:00
Przemyslaw Skibinski
3a415594b1
fixed MinGW compilation
2016-11-03 12:59:20 +01:00
Przemyslaw Skibinski
1f60eb6b17
Merge remote-tracking branch 'refs/remotes/facebook/dev' into dev11
2016-11-03 11:38:04 +01:00
Przemyslaw Skibinski
26306fcacf
BMK_SetNbIterations renamed to BMK_SetNbSeconds
2016-11-03 11:38:01 +01:00
Przemyslaw Skibinski
b40884f43d
preserve file modification time for Visual C++
2016-11-03 09:54:53 +01:00
Yann Collet
7347869fb6
fixed make install
2016-11-02 22:28:37 -07:00
Yann Collet
179b19776f
fileio.c does no longer need ZSTD_LEGACY_SUPPORT, and does no longer depend on zstd_legacy.h
...
Added : ZSTD_isFrame() in experimental section
2016-11-02 17:30:49 -07:00
Yann Collet
f3f13211ae
Fix #419 : no warning when setting custom LDFLAGS
2016-11-02 17:02:45 -07:00
Przemyslaw Skibinski
fcf22e3473
set permissions, access and modification times
2016-11-02 14:08:07 +01:00
Przemyslaw Skibinski
a42794df61
preserve file modification time
2016-11-02 13:08:39 +01:00
Przemyslaw Skibinski
d872b64f52
added UTIL_setModificationTime, UTIL_getModificationTime
2016-11-02 12:52:20 +01:00
Yann Collet
3d197d4c8c
updated man page
2016-10-31 18:10:32 -07:00
Yann Collet
b9550d6d43
fixed benchmark mode typo .
...
added benchmark mode tests
2016-10-28 14:43:24 -07:00
Yann Collet
22de81e87e
updated man page
2016-10-28 13:58:31 -07:00
Przemyslaw Skibinski
bd0bd0fb65
generate RES files during each compilation
2016-10-28 18:15:34 +02:00
Przemyslaw Skibinski
589a8f27b7
generate_res.bat moved to programs/windres
2016-10-28 13:17:35 +02:00
Przemyslaw Skibinski
76d66dffd0
generate_res moved to programs/windres
2016-10-28 13:16:06 +02:00
Przemyslaw Skibinski
347903cfb5
Windows resources moved to programs/windres/
2016-10-25 10:34:41 +02:00
Yann Collet
a7a4690b0a
use implicit rules to compile zstd_decompress.c
2016-10-18 16:01:03 -07:00
Yann Collet
33fdd099bb
fix command line interpretation
2016-10-17 17:48:48 -07:00
Yann Collet
70077bc9bb
refactor for long commands
2016-10-14 14:41:17 -07:00
Yann Collet
d7b120ab5c
added long commands --memory= and --memlimit-decompress=
2016-10-14 14:22:32 -07:00
Yann Collet
1122349ac2
added long comment --memlimit=
2016-10-14 14:07:11 -07:00
Yann Collet
d4cda27b63
new command -M#, to limit memory usage during decompression ( #403 )
2016-10-14 13:32:20 -07:00
Yann Collet
e19111c42f
make creates libzstd binaries ( #415 )
2016-10-12 11:09:36 -07:00
Nick Terrell
3e82f2b61a
Remove references to GPLv2 license
...
License headers added to Makefiles were taken from `zstd/Makefile`.
2016-10-11 15:28:40 -07:00
inikep
23cec875cd
fixed Makefile targets: zstd-small, zstd-decompress, zstd-compress
2016-10-05 11:56:22 +02:00
Nick Terrell
2b4de225e1
Don't redefine macro in util.h
2016-09-22 18:02:39 -07:00
Nick Terrell
5b2c0dbed0
Add include guards to datagen.h
2016-09-22 17:12:50 -07:00
Yann Collet
993060e0f2
cli : better adaptation to small files
2016-09-21 16:46:08 +02:00
Yann Collet
714464f05d
fixed : cli : forgotten mandatory argument
2016-09-21 16:05:03 +02:00
Yann Collet
27b5ac666e
Implemented "command must be followed by argument" protection
...
suggested by @terrelln (#375 )
2016-09-21 14:31:22 +02:00
Yann Collet
0977f7ece6
minor refactor for clarity
2016-09-21 12:24:43 +02:00
Yann Collet
dbe70bad48
completed change from projects to build
2016-09-19 15:08:43 +02:00
Yann Collet
60038948e6
added -- command in help
2016-09-16 18:52:52 +02:00
inikep
3e70cf8036
Merge remote-tracking branch 'refs/remotes/facebook/dev' into dev
2016-09-15 20:41:40 +02:00
inikep
6173931868
fixed memory leak reported by bryongloden
2016-09-15 18:58:18 +02:00
Yann Collet
a6bdf55759
fixed memory leak
2016-09-15 17:02:06 +02:00
Yann Collet
43eeea4725
fileio uses ZSTD_resetCStream()
2016-09-15 15:38:44 +02:00
Yann Collet
0b01a8ef09
Merge pull request #366 from inikep/dev
...
zstd.exe has FileVersion and ProductVersion with 32-bit gcc (MinGW)
2016-09-14 19:42:29 +02:00
Yann Collet
3ecbe6a37c
fileio uses ZSTD_resetDStream()
2016-09-14 17:26:59 +02:00
inikep
c03f15e89d
zstd.exe has FileVersion and ProductVersion with 32-bit gcc (MinGW)
2016-09-14 16:16:24 +02:00
Yann Collet
64a84edef5
added -r support for Mac OS-X
2016-09-13 17:54:37 +02:00
Yann Collet
c4cc9bf973
-r generates an error on systems which do not support it
2016-09-13 17:50:08 +02:00
inikep
9f25fcf804
fixed precision warnigns
2016-09-13 16:38:54 +02:00
inikep
362708d4d2
zstd.exe has FileVersion and ProductVersion
2016-09-13 13:53:43 +02:00
inikep
1c5ba8a5e7
util.h: removed dependency from PATH_MAX
2016-09-13 13:13:10 +02:00
Yann Collet
a3481d6de0
make uninstall
2016-09-12 05:04:26 +02:00
Yann Collet
d77f2ceee6
Merge branch 'dev' of github.com:Cyan4973/zstd into dev
2016-09-12 03:14:03 +02:00
Yann Collet
5c6d244973
Merge branch 'dev' of github.com:facebook/zstd into dev
2016-09-07 14:54:54 +02:00
Yann Collet
ac8bace6b1
support large skippable frames
2016-09-07 14:54:23 +02:00
Yann Collet
03d3f238de
minor comment
2016-09-07 07:01:33 +02:00
Yann Collet
aad9fe5470
don't remove() /dev/null ( #316 )
2016-09-07 07:00:08 +02:00
Yann Collet
7ae67bb18a
small compression speed gains with using_CDict
2016-09-06 06:28:05 +02:00
Thomas Klausner
b85cdabd50
Enable install targets for NetBSD.
2016-09-04 14:37:57 +02:00
Yann Collet
33a0465a51
fixed a few links
2016-09-02 22:11:49 -07:00
Yann Collet
5b8c024716
fixed zstd-pgo ( #329 ) reported by @octoploid
2016-09-02 09:44:00 -07:00
Yann Collet
60181e3aaf
zstd cli correctly detects console on Mac OS-X
2016-09-01 17:14:02 -07:00
Yann Collet
c843142ad0
zstd -d writes to stdout when input is stdin
2016-09-01 15:05:57 -07:00
Yann Collet
1c59c20903
removed redundant files
2016-08-31 07:15:44 -07:00
Yann Collet
599c69d917
minor Makefile updates
2016-08-30 13:33:20 -07:00
Yann Collet
4ded9e591c
added boilerplate
2016-08-30 11:06:28 -07:00
Yann Collet
09c3c8e885
Merge pull request #307 from inikep/dev08
...
updated README.md
2016-08-29 16:32:33 -07:00
inikep
6416b0d705
updated README.md
2016-08-29 13:04:26 +02:00
Yann Collet
54caf6893e
Removed fileio_legacy; now legacy supports relies entirely on streaming API.
...
CLI legacy support now limited to v0.4+
2016-08-28 19:20:13 -07:00
Yann Collet
9097f7b156
fixed versionsTest
2016-08-28 16:25:56 -07:00
Yann Collet
1c69baa1a9
CLI supports Legacy formats v0.4+
2016-08-28 12:47:17 -07:00
Yann Collet
5f53b0335e
fixed continuation context
2016-08-28 10:00:49 -07:00
Yann Collet
ab267e772c
removed fileio specific legacy support;
...
now depends on ZSTD_decompressStream() transparent legacy support
2016-08-28 08:46:25 -07:00
Yann Collet
87c18b2ebd
fixed multiple minor warnings for XCode
2016-08-26 01:43:47 +02:00
Yann Collet
0baa64a763
increased maximum memory size for 64-bits bench to 16 GB
2016-08-25 22:54:13 +02:00
inikep
de9d13068f
updated zstd_compression_format.md
2016-08-25 14:59:08 +02:00
inikep
0132375ba6
improved zstd_compression_format.md
2016-08-25 12:20:38 +02:00
inikep
637d33566d
minor README.md corrections
2016-08-25 10:42:49 +02:00
inikep
ab2f7708c1
created programs\README.md
2016-08-25 10:07:20 +02:00
inikep
e416e30019
remove unnecessary comments
2016-08-24 17:32:09 +02:00
inikep
7bcdbcf51d
Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into Other
2016-08-24 17:09:19 +02:00
Yann Collet
d1733f7417
fixed crc bug in rare timing conditions within bench.c
2016-08-21 01:04:46 +02:00
inikep
c629776b31
make clean will remove decompress/zstd_decompress.o
2016-08-19 10:45:59 +02:00
Yann Collet
b571a0eab4
Merge pull request #298 from inikep/Other
...
Other
2016-08-18 17:14:03 +02:00
inikep
b6514d2496
improved .gitignore
2016-08-18 16:53:29 +02:00
Yann Collet
49d105cfcf
better warning and error messages in case of dictionary training failure ( #292 )
2016-08-18 15:02:11 +02:00
inikep
2868d565e4
test-related files moved to tests/
2016-08-18 13:18:11 +02:00
Yann Collet
e80d15304a
Merge pull request #296 from inikep/Other
...
Other
2016-08-18 11:48:48 +02:00
inikep
a7bb322a93
removed never referenced functions
2016-08-18 10:30:21 +02:00
inikep
5a54870047
fixed Intel Compiler warnings with Visual Studio
...
http://encode.ru/threads/2119-Zstandard?p=49504&viewfull=1#post49504
2016-08-18 09:00:25 +02:00
Yann Collet
bfdc34e5a3
Merge pull request #294 from inikep/Other
...
improved Makefiles
2016-08-17 19:41:56 +02:00
inikep
79b4062c81
fixed paramgrill dependency
2016-08-17 16:29:57 +02:00
inikep
d0c270fe85
improved programs\Makefile
2016-08-17 15:59:50 +02:00
inikep
78f3e0630b
disabled %llu warnings with MinGW on Windows
2016-08-17 14:52:11 +02:00
Yann Collet
3d9211e961
Merge pull request #290 from david-y-lam/fix_file_name
...
Remove file name truncation in zstd CLI output
2016-08-17 14:05:29 +02:00
Yann Collet
53e17fbd5e
updated streaming API
2016-08-17 01:39:22 +02:00
Yann Collet
94ca85d01b
fixed Visual warning
2016-08-16 15:11:28 +02:00
Yann Collet
6263ba5451
fileio uses new streaming API
2016-08-16 15:11:28 +02:00
Yann Collet
fb5e385164
minor changes
2016-08-16 15:11:28 +02:00
Yann Collet
d7883a2c0e
added zstreamtest
2016-08-16 15:11:28 +02:00
David Lam
0f2704581e
Remove truncation of filename in zstd CLI log lines
2016-08-13 11:26:21 -07:00
David Lam
ac43e9582e
Add more descriptive message to -v option in zstd CLI
2016-08-12 17:47:18 -07:00
Yann Collet
fab023010d
changed test, in compliance with new --ultra policy
2016-08-12 19:00:18 +02:00
Yann Collet
fe0590f63f
new --ultra policy
2016-08-12 18:04:15 +02:00
inikep
7132fb15ba
bench.c: removed benchResult_t
2016-08-10 14:59:18 +02:00
inikep
3d2c58c3a9
fixed compilation with Visual in C++ mode
2016-08-10 14:28:47 +02:00
Yann Collet
666398e7ed
added : xxhash namespace enforced from xxhash.h.
...
added : xxhash namespace test.
removed : -DXXH_NAMESPACE
2016-08-10 08:16:51 +02:00
Yann Collet
6a21971f4a
bench : implemented avgSize
2016-08-03 00:06:24 +02:00
Yann Collet
bf2bc112bb
bench : controlled display update when loading lot of files
2016-08-02 23:48:13 +02:00
Yann Collet
de4c04f6c2
Fixed : ZSTD_compress* can compress > 4 GB in a single pass, reported by Nick Terrell
2016-08-02 11:27:05 +02:00
Yann Collet
9a69ec4f3b
added : resilience test for ZSTD_getErrorName()
2016-08-01 16:25:58 +02:00
Yann Collet
415251c63b
minor style change
2016-08-01 14:26:49 +02:00
Yann Collet
a9febe81ae
changed bench behavior for slow compression levels
2016-08-01 13:40:52 +02:00
Yann Collet
2a2ba3691c
Merge pull request #266 from jrmarino/master
...
Enable build on FreeBSD ports (includes DragonFly BSD) [dev branch]
2016-07-31 02:21:26 +02:00
jrmarino
0d07ec0c0c
Enable build on FreeBSD ports (includes DragonFly BSD)
...
Zstd has been introduced to FreeBSD ports
(http://www.freshports.org/archivers/zstd/ ) which DragonFly BSD also
uses. FreeBSD and DragonFly use the install targets (albeit modified in
some cases) so they must be added to the associated Makefile filters.
2016-07-30 19:11:15 -05:00
Yann Collet
235911e13f
removed "avg" evaluation from bench -q
...
removed "sleeping" notification from bench -q
2016-07-31 01:32:48 +02:00
Yann Collet
4c5bbf64f9
fixed : frame concatenation without checksum
2016-07-28 20:30:25 +02:00
Yann Collet
60ba31c570
zbuff uses ZSTD_compressEnd()
2016-07-28 19:55:09 +02:00
Yann Collet
62470b4bab
Changed ZSTD_compressEnd()
2016-07-28 15:29:08 +02:00
Yann Collet
c991cc1828
new frame end, 32-bits checksums
2016-07-28 00:55:43 +02:00
Yann Collet
4110534886
ZSTD_maxCLevel() is promoted to "stable" API ( #254 , by @FrancescAlted)
2016-07-27 15:09:11 +02:00
Yann Collet
dd25a27702
added tutorial warning messages for dictBuilder
2016-07-27 12:43:09 +02:00
Yann Collet
fbd557d5c2
multi-files -t doesn't stop after detecting magic number read failure
2016-07-26 17:13:58 +02:00
Yann Collet
a1dd6b97d2
fixed null-length round trip
2016-07-26 16:44:09 +02:00
Yann Collet
7adc2328a3
fixed --test on zero-length files, reported by @amnilsson
2016-07-26 15:49:24 +02:00
Yann Collet
9cebec21e1
Merge pull request #259 from inikep/dev08
...
legacy decoder for v0.7 format
2016-07-26 15:13:05 +02:00
inikep
7bc5c6b5cb
util.h: detect if an error occurs in readdir() (thanks to Jim Meyering)
2016-07-26 11:07:37 +02:00
Yann Collet
24a3d90bf0
strengthened integrity tests
2016-07-26 01:33:20 +02:00
Yann Collet
b402490546
fixed #260 , reported by @amnilsson
2016-07-26 00:49:47 +02:00
inikep
fca90f8f60
legacy decoder for v0.7 format
2016-07-25 17:49:08 +02:00
Yann Collet
e5a817a2d8
better MOREFLAGS
2016-07-24 17:46:05 +02:00
Yann Collet
10b9c13d07
fixed doc on cLevel default, reported by Oliver Lange
2016-07-24 01:21:53 +02:00
Yann Collet
f8e7b5363f
unified encoding types
2016-07-23 16:31:49 +02:00
Yann Collet
b752298d1d
fixed 32-bits compilation
2016-07-22 14:37:09 +02:00
Yann Collet
32faf6c8e7
fixed conversion warnings
2016-07-22 14:37:09 +02:00
Yann Collet
5e45a5fbb3
force loop-align to 32 for zstd_decompress
2016-07-22 14:37:09 +02:00
Yann Collet
5288ac0cb7
changed filed order
2016-07-22 14:37:09 +02:00
Yann Collet
6fa05a2371
cBlockSize uses little-endian convention
2016-07-22 14:37:09 +02:00
Yann Collet
06dd74114a
minor : long tests display progression status
2016-07-18 04:06:43 +02:00
Yann Collet
85f3919960
moved zstd.h to /lib
2016-07-17 20:42:21 +02:00
Yann Collet
988bcf360a
-v and --verbose increase display level by 1
2016-07-15 19:43:30 +02:00
Yann Collet
d3d2db587e
adapted fuzzer test to new blockSizeMax rule for ZSTD_compressBlock()
2016-07-15 12:20:26 +02:00
Yann Collet
227cc39e15
improved efficiency for large messages with small dictionaries
2016-07-15 11:27:09 +02:00
Yann Collet
e20d5cf117
fixed paramgrill
2016-07-14 20:46:24 +02:00
Yann Collet
17508f1a16
fixed a few minor coverity warnings
2016-07-14 17:18:20 +02:00
Yann Collet
69c2cdb45c
fixed conversion warning
2016-07-14 16:52:45 +02:00
Yann Collet
44f684ded3
fixed minor coverity warning
2016-07-13 20:12:33 +02:00
Yann Collet
5e80dd3261
fixed minor coverity warnings
2016-07-13 19:21:57 +02:00
Yann Collet
158e7703bb
reduced paramgrill dependency to C standard lib only
2016-07-13 16:45:24 +02:00
Yann Collet
2b1a3638e6
changed macro name to ZSTDCLI_CLEVEL_DEFAULT
2016-07-13 15:16:00 +02:00
Yann Collet
3c242e79d3
updated compression levels table
2016-07-13 14:56:24 +02:00
Yann Collet
2cac5b30b9
changed default compression level to 3 (can be modified with macro ZSTDCLI_DEFAULT_CLEVEL)
2016-07-13 14:15:08 +02:00
Yann Collet
696c4d7ef5
new paramgrill mode : -O# : find optimal parameters for a given sample and a given target speed
2016-07-13 13:11:08 +02:00
Yann Collet
650a8778c1
minor filter improvement
2016-07-13 11:49:05 +02:00
Yann Collet
a43a854cdb
updated paramgrill
2016-07-12 13:42:10 +02:00
Yann Collet
45dc35628c
first version of doubleFast
2016-07-12 09:47:31 +02:00
Yann Collet
3ae543ce75
added ZSTD_estimateCCtxSize()
2016-07-11 03:12:17 +02:00
Yann Collet
aa2628da30
added : ZSTD_insertBlock(), basic tests
2016-07-07 15:28:41 +02:00
Yann Collet
19c27d27f1
simplified legacy functions, no longer need magic number
2016-07-07 14:40:13 +02:00
Yann Collet
e72efeb0a1
removed "error_public.h" dependency from "zstd.h"
2016-07-07 14:17:40 +02:00
Yann Collet
f323bf7d32
added : ZSTD_getDecompressedSize()
2016-07-07 13:14:21 +02:00
Yann Collet
a3d03a3973
added <errno.h> dependency
2016-07-06 16:27:17 +02:00
Yann Collet
bcb5f77efa
dictBuilder manages better samples of null size 0 and large size > 128 KB
2016-07-06 15:41:03 +02:00
Yann Collet
9ca73364e6
updated spec
2016-07-05 10:53:38 +02:00
Yann Collet
f9cac7a734
Added GNU separator --, to specifies that all following arguments are necessary file names (and not commands). Suggested by @chipturner ( #230 )
2016-07-04 18:18:24 +02:00
Yann Collet
92c986b4e8
fixed cmake error (missing errno)
2016-07-04 01:37:30 +02:00
Yann Collet
d916c908e0
updated doc
2016-07-04 00:42:58 +02:00
Yann Collet
440bb637e2
Merge pull request #238 from juanfra684/patch-2
...
Add OpenBSD to the Makefile test.
2016-07-04 00:38:19 +02:00
Juan Francisco Cantero Hurtado
06ad6f1911
Add OpenBSD to the Makefile test.
2016-07-03 22:16:00 +02:00
Juan Francisco Cantero Hurtado
fb5c59fc89
Redundant entry for options in the man page.
...
".SH OPTIONS" is enough.
2016-07-03 22:15:26 +02:00
Yann Collet
5cc1882d45
fixed minor visual warning
2016-07-03 19:03:13 +02:00
Yann Collet
c62cda9def
fileio.c no longer depends on zstd_internal.h
2016-07-03 01:36:57 +02:00
Yann Collet
92d75667e4
fix for fast mode
2016-07-03 01:10:53 +02:00
Yann Collet
b2b5309c6f
removes Visual warning on strerror()
2016-07-03 00:20:03 +02:00
Yann Collet
f4b7b747c7
-c does no longer modify displayLevel when -v set.
2016-07-02 22:57:28 +02:00
Yann Collet
ed7fb8413c
extended use of strerror(errno)
2016-07-02 21:01:54 +02:00
Yann Collet
b71adf45c1
extended use of strerror(errno)
2016-07-02 01:51:12 +02:00
Yann Collet
b7f197633a
use strerror(errno) to return system error message
2016-07-02 00:59:25 +02:00
Yann Collet
a7a5d7736c
Updated doc
2016-07-02 00:37:32 +02:00
Yann Collet
cebab1d322
Explicit error message when dst file cannot be created / opened
2016-07-02 00:12:14 +02:00
Yann Collet
6c6e1751f6
use ZSTD_getParams() to simplify code
2016-06-27 15:28:45 +02:00
Yann Collet
3d2cd7f816
Introduced ZSTD_getParams()
...
bench now uses ZSTD_createCDict_advanced()
2016-06-27 15:12:26 +02:00
Yann Collet
ec224d256d
removed useless context
2016-06-27 13:39:30 +02:00
Yann Collet
4c56f4a3cf
fixed error messages
2016-06-27 13:36:54 +02:00
Yann Collet
d4f4e58ee1
fixed ZSTD_decompressBlock() using multiple blocks
2016-06-27 01:31:35 +02:00
inikep
9649126f70
Merge remote-tracking branch 'refs/remotes/origin/speedTest' into dev
2016-06-22 16:22:29 +02:00
inikep
d7d251ccb5
bench.c: added support for ZSTD_GIT_COMMIT
2016-06-22 16:13:25 +02:00
inikep
f2f59d758e
test-zstd-speed.py: added ZSTD_GIT_COMMIT
2016-06-22 15:42:26 +02:00
Yann Collet
8d30cd562a
Merge pull request #219 from inikep/dev
...
added gcc5test and gcc6test for Travis
2016-06-21 21:51:52 +02:00
Yann Collet
391a128794
fix : segfault in command line during automatic overwrite protection mode
2016-06-21 17:06:25 +02:00
Yann Collet
446d442989
zbufftest now ensures ZBUFF_compressEnd() is fully flushed in a single pass if dst buffer is large enough
2016-06-21 14:14:02 +02:00
Yann Collet
f15c1cb00c
Fixed : ZBUFF_compressEnd() called multiple times with too small dst buffer ( #206 )
2016-06-21 13:11:48 +02:00
Yann Collet
2565971ea4
stronger fuzzer tests for ZBUFF_compressEnd()
2016-06-21 12:17:26 +02:00
inikep
9bf5357101
bench.c: use ZSTD_VERSION_STRING
2016-06-21 11:01:29 +02:00
Yann Collet
c98f8e7b57
Modified : zstd CLI enables checksum by default
2016-06-20 16:31:24 +02:00
Yann Collet
cbf8c52954
roundTripCrash automatic compression level now depends on first 128 bytes
2016-06-20 16:18:19 +02:00
Yann Collet
19cab46f2f
Joined seqStore initialization at dispatch point
2016-06-17 12:54:52 +02:00
Yann Collet
3f01c8833f
better seed randomization for systems with poor clock() resolutation
2016-06-16 13:38:10 +02:00
Yann Collet
803c05ec7e
fuzzer : tests with high id are run without need to change finalTestNb
2016-06-16 11:32:57 +02:00
Yann Collet
23ccc34262
Merge branch 'dev' of github.com:Cyan4973/zstd into dev
2016-06-15 23:33:52 +02:00
Yann Collet
1a7b8fbc24
fixed dictionary tests
2016-06-15 23:33:38 +02:00
Yann Collet
9b998e4d08
Fixed decompression of literals in dictionary mode
2016-06-15 23:11:20 +02:00
Tobias Ibounig
3915545605
Fix Max Compression Level in zstd.1
2016-06-15 22:20:46 +02:00
Yann Collet
531a4273c0
stronger dictionary compression tests
2016-06-15 19:02:11 +02:00
Yann Collet
1869f7966e
Merge pull request #205 from inikep/dev
...
legacy decoder for v0.6
2016-06-10 17:13:07 +02:00
Yann Collet
b09b12ce10
Added command --rm : remove source file after successful de/compression
2016-06-09 23:01:19 +02:00
inikep
bf853d5510
added legacy decoder for v0.6 format
2016-06-09 17:59:18 +02:00
Yann Collet
ee1a084852
Integrated new dictionary API into bench module
2016-06-07 01:40:49 +02:00
Yann Collet
f72dc6091b
removed msan tests, due to issues with datagen.c
2016-06-06 19:42:47 +02:00
Yann Collet
2cc72f1fd3
fixed initialization issue in bench
2016-06-06 17:50:07 +02:00
Yann Collet
673f0d7cdc
new frame format, allowing custom window size
2016-06-06 00:26:38 +02:00
Yann Collet
a91ca620cf
removed HUF_readStats() from public space
2016-06-05 01:33:55 +02:00
Yann Collet
f3a1a84c9a
fixed cmake project
2016-06-05 01:05:01 +02:00
Yann Collet
d0e2cd15cb
Merged fse_static into fse.h . Now requires FSE_STATIC_LINKING_ONLY macro.
2016-06-05 00:58:01 +02:00
Yann Collet
d3b7f8d21f
Merged zstd_static.h into zstd.h . Now requires ZSTD_STATIC_LINKING_ONLY macro
2016-06-04 19:47:02 +02:00
Yann Collet
5347aee8f7
merged zbuff_static.h into zbuff.h . Now requires ZBUFF_STATIC_LINKING_ONLY macro
2016-06-04 19:12:48 +02:00
Yann Collet
e69b8ccceb
merged zdict_static.h into zdict.h. Now requires ZDICT_STATIC_LINKING_ONLY macro.
2016-06-04 18:56:23 +02:00
Yann Collet
0d31160b4e
better dynamic memory adaptation when using CLI
2016-06-04 00:09:02 +02:00
Yann Collet
ab7b6f1ece
Merge pull request #198 from inikep/dev070
...
Dev070
2016-06-03 21:37:49 +02:00
Yann Collet
441f5d61fd
dictionary size objective can be described in Megabytes
2016-06-03 15:15:47 +02:00
Yann Collet
1dd7961557
minor code refactoring
2016-06-03 15:14:09 +02:00
inikep
36fac00149
removed calloc calls from lib/
2016-06-03 13:23:04 +02:00
inikep
db2f540414
added defaultCustomNULL
2016-06-03 12:56:56 +02:00
inikep
ff2d18928d
zlibWrapper: added gcc flag -Wdeclaration-after-statement
2016-06-02 22:15:09 +02:00
inikep
b74a468fad
Merge remote-tracking branch 'refs/remotes/Cyan4973/dev070' into dev070
2016-06-02 22:09:09 +02:00
inikep
7cab86f647
ZWRAP_allocFunction and ZWRAP_freeFunction are static
2016-06-02 18:24:07 +02:00
Yann Collet
923938edde
Added -Wdeclaration-after-statement compilation flag
2016-06-02 17:56:00 +02:00
Yann Collet
2c4acdabdc
Changed command name to --check , -C, following xz convention
2016-06-02 17:05:50 +02:00
inikep
ff9114aee3
zlibWrapper: added support for custom memory allocation functions
2016-06-02 16:52:36 +02:00
inikep
2866951558
opaque parameter for custom memory allocation functions
2016-06-02 13:04:18 +02:00
Yann Collet
87cfbe3e5f
checksum generation can be selected from command line (--checksum)
2016-06-01 19:22:15 +02:00
Yann Collet
eb70043e59
Fixed paramgrill
2016-06-01 18:59:55 +02:00
Yann Collet
70d1301d6e
Changed ZSTD_adjustCParams() prototype
...
`ZSTD_adjustCParams()` is now automatically invoked at the end of `ZSTD_getCParams()`
2016-06-01 18:45:34 +02:00
Yann Collet
83c3f4427c
upgraded zbufftest to also test advanced frame parameters no/checksum no/dictID
2016-06-01 17:44:53 +02:00
inikep
5c2771710d
Merge remote-tracking branch 'refs/remotes/Cyan4973/dev070' into dev070
...
# Conflicts:
# .gitignore
# lib/decompress/zstd_decompress.c
# programs/zbufftest.c
2016-06-01 09:16:11 +02:00
Yann Collet
202844ebd0
fixed zbufftest :
2016-06-01 00:44:36 +02:00
inikep
00fa1ae0c0
update playTests.sh permission
2016-06-01 00:13:02 +02:00
inikep
a6b942018d
Merge remote-tracking branch 'refs/remotes/origin/dev' into dev070
...
# Conflicts:
# .travis.yml
# Makefile
# lib/common/zstd_static.h
# programs/Makefile
# projects/VS2008/zstd/zstd.vcproj
# projects/VS2008/zstdlib/zstdlib.vcproj
# projects/cmake/lib/CMakeLists.txt
# projects/cmake/programs/CMakeLists.txt
2016-06-01 00:07:09 +02:00
Yann Collet
f2a3b6e7b4
added : frame content checksum
2016-05-31 22:23:45 +02:00
inikep
cf6edcd0a1
zbufftest.c: fixed g++ warning
2016-05-31 20:21:43 +02:00
inikep
43aa9fe8b3
fixed skippable frame
2016-05-31 19:36:51 +02:00
inikep
5bee32e349
cmake project works with MSYS
2016-05-31 13:36:14 +02:00
inikep
f772bf54a5
support for skippable frames
2016-05-31 12:43:46 +02:00
Yann Collet
6fca9e7545
Changed : max dictionary file size increased to 8 MB
2016-05-31 02:40:42 +02:00
Yann Collet
6381e99fb2
Added : ability to create compressed frames without dictID
2016-05-31 02:29:45 +02:00
Yann Collet
b81cbbade1
fixed minor conversion warning
2016-05-30 22:29:45 +02:00
Yann Collet
290aaa7521
Added : ability to manually select the dictionary ID of a newly created dictionary
2016-05-30 21:18:52 +02:00
cyan
b880631aed
Fixed visual projects
...
Signed-off-by: Yann Collet <yann.collet.73@gmail.com>
2016-05-30 18:28:29 +02:00
Yann Collet
30009521d7
fuzzer tests dictBuilder.
...
Added : ability to not store dictID during compression; decompression doesn't check dictID then
2016-05-30 16:17:33 +02:00
Yann Collet
d2858e93cb
minor refactoring
2016-05-30 15:11:17 +02:00
inikep
1dcb2ff23f
improved scripts compatibility
2016-05-30 11:33:52 +02:00
inikep
957d678031
update playTests.sh perimissions
2016-05-30 10:23:52 +02:00
inikep
93fc13ebc8
playTests.sh working with Linux, Windows, OS X
2016-05-30 10:17:55 +02:00
Yann Collet
c0a9bf3c2e
minor code refactoring
2016-05-30 04:48:32 +02:00
Yann Collet
954e2bc48f
added fuzzer test for ZSTD_compressBegin_advanced()
2016-05-30 01:42:05 +02:00
Yann Collet
33341de7d7
fixed fuzzer dictionary test
2016-05-29 23:09:51 +02:00
Yann Collet
fcf2087a15
restored zstdcli.c
2016-05-29 05:16:05 +02:00
Yann Collet
c46fb924df
added dictionary ID (incomplete)
2016-05-29 05:01:04 +02:00
Yann Collet
0d348d46d8
fixed cmake
...
fixed playTests
2016-05-29 02:02:24 +02:00
Yann Collet
f51e0660f4
Simplified list of *.c files
2016-05-29 01:39:19 +02:00
Yann Collet
0c5e8b17ad
moved xxhash to lib/common
2016-05-29 01:06:30 +02:00
Yann Collet
ab2ee08042
fixed makefile error in clean target
2016-05-28 16:06:29 +02:00
Yann Collet
fb0ba59c41
Added : utility roundTripCrash
...
which generates a crash (double-free) on detecting a round-trip corruption
2016-05-28 15:30:01 +02:00
Yann Collet
6c903a8dd5
updated xxhash to latest "dev" version
2016-05-28 13:34:07 +02:00
inikep
993a9dfc5a
playTests.sh updated to work better with /bin/sh
2016-05-27 10:07:46 +02:00
inikep
bff23b72c5
fixed Visual Studio warning
2016-05-25 17:40:58 +02:00
inikep
957823f56f
zstdcli: -r (operate recursively on directories) works with dictBuilder and compression
2016-05-25 15:30:55 +02:00
inikep
4f1acdd158
usage of fileno() only on POSIX and Windows
2016-05-25 12:41:41 +02:00
inikep
e75909ef93
ZBUFF_createCCtx_advanced moved to zbuff_static.h
2016-05-25 11:31:16 +02:00
inikep
5d589562fe
playTests.sh joined with playTestsMSYS.sh
2016-05-25 10:50:28 +02:00
inikep
460a4ee6d4
playTests updated with Pass-Through mode
2016-05-24 18:22:38 +02:00
inikep
02c244bf78
Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev
2016-05-24 17:15:04 +02:00
inikep
fb5df613cf
zstd_stats.h included only in debug mode
2016-05-24 15:36:37 +02:00
inikep
a1653fbfd0
zbufftest.c: tests for ZBUFF_createCCtx_advanced/ZBUFF_createDCtx_advanced
2016-05-24 15:35:48 +02:00
inikep
71dd67cf57
fullbench: tests for ZBUFF_createCCtx_advanced and ZBUFF_createDCtx_advanced
2016-05-24 10:57:14 +02:00
Yann Collet
ddbb8e27bf
fixed minor conversion warning
2016-05-24 00:52:14 +02:00
Yann Collet
de95f96462
Pass-Through mode support (using -df), for compatibility with gzip
2016-05-23 19:46:47 +02:00
Yann Collet
32990b5dae
Added tests for Sparse mode support
...
Fixed : complex cli arg case involving a mix of `stdin` and `-o`
2016-05-23 17:48:57 +02:00
Yann Collet
75424d1139
Added : Sparse write support
...
--[no-]sparse command
2016-05-23 16:56:56 +02:00
Peter (Stig) Edwards
04773ac90a
Minor changes needed for OpenVMS
...
Define util sleep functions on VMS.
If PRIO_PROCESS is not defined then do not attempt to use it in the definition of SET_HIGH_PRIORITY.
2016-05-21 12:15:48 +01:00
Yann Collet
45f84ab7cc
all programs use ZSTD_VERSION_STRING from zstd.h to display their version
2016-05-20 12:34:40 +02:00
Yann Collet
de4d4da52d
changed version to 0.6.2
...
removed make-controlled version (now used from zstd.h)
removed std=c99 by default
added : c90/gno90/c99/gnu99/c11 tests
2016-05-20 12:20:12 +02:00
Yann Collet
e162aceeb6
minor simplification
2016-05-20 11:35:00 +02:00
inikep
96abb5a806
AppVeyor tests use playTests.bat
2016-05-19 15:50:58 +02:00
inikep
44bb2f6c89
added datagen in Visual Studio project
2016-05-19 12:16:14 +02:00
inikep
60af95d971
fixed compression with -c with multiple files on Windows
2016-05-19 10:29:49 +02:00
inikep
2bd6b13e53
added playTests.bat
2016-05-18 18:05:56 +02:00
inikep
3aa4b2b598
update file permission
2016-05-18 18:04:10 +02:00
Yann Collet
35276a9441
fixed minor conversion warnings
2016-05-18 17:26:23 +02:00
Yann Collet
bde926fce7
removed msan tests
2016-05-18 17:18:48 +02:00
inikep
f33021552b
added playTestsMSYS.sh
2016-05-18 16:38:36 +02:00
klemens
268775dae8
spelling-fixes, as of lintian.debian.org
2016-05-16 22:23:24 +02:00
inikep
63ecd747de
added common/entropy_common.c
2016-05-13 11:27:56 +02:00
inikep
58a1d45aa5
Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev
2016-05-13 11:05:35 +02:00
inikep
0bdb6a8118
changed definition of UTIL_createFileList
2016-05-13 10:52:02 +02:00
inikep
3eabe9b474
added zlibWrapper - zstd wrapper for zlib
2016-05-12 17:15:41 +02:00
inikep
4dbf7f4a3b
dynamic memory allocation in UTIL_createFileList
2016-05-11 14:11:00 +02:00
Yann Collet
a96f9fd5bc
datagencli uses mem.h
2016-05-11 11:42:51 +02:00
Yann Collet
b3a9938d0c
Merge pull request #182 from inikep/dev
...
support for Visual Studio 2012, 2013, 2015
2016-05-10 17:18:12 +02:00
Yann Collet
b12b369817
fixed : unused argument in printf
2016-05-10 15:30:43 +02:00
inikep
95459458ed
disable Visual Studio code analysis
2016-05-10 14:42:54 +02:00
inikep
3733797fcd
bench.c: experimental -r (operate recursively on directories) for Windows and _POSIX_C_SOURCE >= 200112L
2016-05-10 14:22:55 +02:00
Yann Collet
bd39d54576
zbuff supports byte-by-byte decompression scenarios
2016-05-10 14:14:19 +02:00
inikep
ed9a08538c
Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev
...
# Conflicts:
# lib/common/util.h
# programs/paramgrill.c
# visual/2013/fullbench/fullbench.vcxproj.filters
# visual/2013/fuzzer/fuzzer.vcxproj.filters
2016-05-10 13:20:01 +02:00
Yann Collet
d693117113
fixed : null-length string roundtrip
2016-05-10 05:56:09 +02:00
Yann Collet
8b23eea694
minor refactor : more accurate variables scope
...
Added null-length string test
2016-05-10 05:37:43 +02:00
inikep
349fcf7ea2
fixed Linux compilation
2016-05-09 18:04:07 +02:00
inikep
aaaf923a17
common/util.h moved to programs/util.h
...
decompress/fse_decompress.c moved to common/
2016-05-09 16:19:25 +02:00
Yann Collet
d782890576
fixed datagen
2016-05-09 12:28:20 +02:00
Yann Collet
ceca200c77
datagen uses mem.h
2016-05-09 12:20:50 +02:00
Yann Collet
59b6ba7677
Merge pull request #180 from thatsafunnyname/patch-1
...
No stdint.h on OpenVMS.
2016-05-09 11:56:42 +02:00
Yann Collet
f6ca09b5ff
Reduced console display on loading lots of files with zstd --train. Reported by @KrzysFR, see #177
2016-05-09 04:44:45 +02:00
Yann Collet
95af06f6ef
fixed legacy dictionary decompression
2016-05-08 08:23:51 +02:00
Yann Collet
0c0f314550
CLI supports dictionary decompression in legacy mode v0.5.x
2016-05-08 08:11:24 +02:00
Yann Collet
f849462d4c
minor refactor : more accurate variable scope
2016-05-07 22:43:40 +02:00
inikep
13c8424ea0
code cleaning
2016-05-05 13:58:56 +02:00
inikep
0bd0faec32
fixed compatibility issues
2016-05-05 13:10:57 +02:00
inikep
9c22e57bfb
Compiler Options moved to util.h
2016-05-05 11:53:42 +02:00
Yann Collet
3f8ed50bf1
Added gnu90 test
...
work-around : disabled automatic selection of huff0 quad-decoder (see #173 )
2016-05-05 03:01:13 +02:00
thatsafunnyname
dca5cf92ac
No stdint.h on OpenVMS.
...
No stdint.h on OpenVMS, it is inttypes.h instead, some projects use HAVE_STDINT_H.
2016-05-04 15:42:25 +01:00
thatsafunnyname
eef5fdb58a
No stdint.h on OpenVMS.
...
No stdint.h on OpenVMS, it is inttypes.h instead, some projects use HAVE_STDINT_H.
2016-05-04 15:39:31 +01:00
Yann Collet
6f9c056662
Fixed BMI behavior on x86 and x32 targets, reported by @tycho ( #178 )
2016-05-01 10:26:30 +02:00
inikep
bab4317961
util.h must the the first include to #define _POSIX_C_SOURCE
2016-04-29 15:19:40 +02:00
inikep
55d047aa92
getTotalFileSize moved to common/util.h
2016-04-28 16:50:13 +02:00
inikep
d5ff2c3d9a
ordering of #include
2016-04-28 14:40:45 +02:00
inikep
83c76b4594
bench.c: time functions moved to common/util.h
2016-04-28 13:16:01 +02:00
inikep
69fcd7c0ae
getFileSize moved to common/util.h
2016-04-28 12:23:33 +02:00
inikep
ea4ee3eee0
added compatibility with Visual C++ 2012
2016-04-25 13:09:06 +02:00
inikep
f066816998
fix for g++ compilation
2016-04-22 18:54:05 +02:00
inikep
db3964382c
introduced ZSTD_NODECOMPRESS to link only compressor
2016-04-22 18:22:30 +02:00
inikep
a1febea01d
Error functions moved to common/zstd_common.c
2016-04-22 17:14:25 +02:00
inikep
3c7c3527d0
introduced ZSTD_NOCOMPRESS to generate decompressor only
2016-04-22 13:59:05 +02:00
inikep
23a0889301
separation of lib/ into common/, compress/, decompress/, dictBuilder/, legacy/
2016-04-22 12:43:18 +02:00
inikep
4699b3be03
Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev
2016-04-21 12:30:58 +02:00
inikep
38654988f3
minor speed improvements 2
...
bench.c: block size has to be bigger than 32 bytes
zstdcli.c: support for e.g. -B16k -B16m
2016-04-21 12:18:47 +02:00
Yann Collet
e02808ffc5
bumped lib version to 0.6.1
...
added ZSTD_VERSION_STRING
2016-04-20 22:46:16 +02:00
inikep
c5e1d295ee
bench.c: force at least one compression and decompression loop
...
fix for -i0 with small files
2016-04-19 09:37:59 +02:00
inikep
6d157f1fbe
bench.c: fixed rare compression and decompression speed bug
...
concerns only big files with compression or decompression time longer
than 100 seconds
2016-04-15 16:54:11 +02:00
inikep
4b3c5eed99
removed ZSTD_compressBegin_targetSrcSize
2016-04-14 13:43:51 +02:00
inikep
c70c90e8a3
Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev
2016-04-13 10:48:26 +02:00
inikep
c0d5f4eb2e
bench.c: ignore directories from a file list for benchmark
2016-04-13 10:48:04 +02:00
Yann Collet
389648cc6d
Fixed : contentSize + copyCCtx()
2016-04-12 19:13:08 +02:00
Yann Collet
541dc7c7d4
Added : fuzzer test, checking contentLength value after copyCCtx() usage
2016-04-12 18:00:20 +02:00
Yann Collet
887e7da785
Fixed copyCCtx() on uninitialized cctx (reported by Oliver Lange)
2016-04-11 20:12:27 +02:00
inikep
8844e21dff
Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev
2016-04-11 16:49:27 +02:00
Yann Collet
81e493651a
Fixed minor conversion warning
2016-04-11 01:47:10 +02:00
Yann Collet
c51aa6ccce
minor refactor
2016-04-11 01:20:14 +02:00
Yann Collet
c456077066
fixed : minor warning on return value
2016-04-11 01:12:32 +02:00
Yann Collet
7928f6f024
Fixed : cli error on stdin + stdout, as detected by Alexey Spiridonov
...
Added : relevant test case
2016-04-10 20:40:26 +02:00
Yann Collet
ccbba296e1
Fix infinite loop with invalid data (fuzzer test)
2016-04-10 14:42:26 +02:00
Yann Collet
4d008083e6
fixed fullbench link stage
2016-04-09 17:38:53 +02:00
Yann Collet
9990986bdc
fixed minor warnings when compiling with gcc -g (aka -std=gnu90)
2016-04-09 16:17:18 +02:00
Yann Collet
029267ab3f
Integrated Legacy v0.5.x decoder (provided by @inikep)
2016-04-09 09:42:27 +02:00
Yann Collet
1fce6e0baa
Fixed : minor variable isolation
2016-04-08 20:26:33 +02:00
inikep
1eeddde625
clock() is default timer for all platforms except Windows
2016-04-08 16:55:17 +02:00
Yann Collet
ea63bb7b5e
converted fuzzer timer to clock_t
2016-04-08 15:25:32 +02:00
Yann Collet
72cc704514
Merge branch 'dev060' of github.com:Cyan4973/zstd into dev060
2016-04-08 02:02:31 +02:00
Yann Collet
0dbf2874ee
faster level 1 at 256 KB
2016-04-08 02:02:12 +02:00
Yann Collet
04a4fd638b
Merge pull request #164 from inikep/dev
...
only repcode 0 for lazy, lazy2 and btlazy2 strategies
2016-04-07 20:46:13 +02:00
Yann Collet
9e8b09a7bd
Fixed memory initialization issue, reported by Maciej Adamczyk
2016-04-07 19:35:23 +02:00
inikep
64d7bcb0dc
only repcode 0 for lazy, lazy2 and btlazy2 strategies
2016-04-07 19:14:09 +02:00
inikep
e47f33f980
reordered code
2016-04-06 20:58:00 +02:00
inikep
5ce00aee37
ZSTD_compressBlock_opt_extDict_generic in progress
2016-04-05 21:03:43 +02:00
inikep
0c7456c5b7
Merge remote-tracking branch 'refs/remotes/Cyan4973/dev060' into dev
...
# Conflicts:
# lib/zstd_compress.c
# lib/zstd_static.h
2016-04-04 14:54:53 +02:00
Yann Collet
8a57b928ba
changed contentLog -> chainLog
2016-04-04 13:49:18 +02:00
inikep
19bd48f516
Merge from Cyan4973/dev060
2016-04-04 12:10:00 +02:00
Yann Collet
1535414927
Fixed 32-bits windowLog limitation
...
Fixed some macro errors in zbufftest
2016-04-04 04:22:53 +02:00
Yann Collet
9bf7016627
minor variable isolation
2016-04-04 03:01:15 +02:00
Yann Collet
fd265ca518
minor cli correction (arguments are const char*)
2016-04-04 02:48:55 +02:00
Yann Collet
38461085d8
code refactorization, for better clarity and reliability
2016-04-04 02:47:20 +02:00
Yann Collet
541cf1993f
minor variable isolation
2016-04-04 01:49:30 +02:00
Yann Collet
15bc943201
stronger zbuff synchronization tests
2016-04-04 01:22:26 +02:00
Yann Collet
fe56eb9408
removed unwanted files
2016-04-02 00:21:55 +02:00
Yann Collet
efb18309ef
fixed minor visual 32-64bits conversion warning
2016-04-01 18:54:13 +02:00
Yann Collet
27caf2afca
minor variable isolation
2016-04-01 15:48:48 +02:00
Yann Collet
51d500425f
fixed paramgrill
2016-03-30 20:42:19 +02:00
Yann Collet
3b71925c2d
separate params into compressionParams and frameParams
2016-03-30 19:48:05 +02:00
inikep
1c556a3838
ticksPerSecond=0
2016-03-30 10:59:48 +02:00
inikep
33ad251236
removed clock_gettime (not portable)
2016-03-30 09:55:37 +02:00
inikep
4611d11fea
added -lrt required by clock_gettime
2016-03-29 15:52:38 +02:00
inikep
4c12f232ec
support for QueryPerformanceCounter and clock_gettime
2016-03-29 14:52:13 +02:00
inikep
06f793a3ab
fix for BMK_clockSpan on Windows
2016-03-29 11:17:58 +02:00
Yann Collet
b44be74244
Fixed zdict
...
more dictionary compression tests
2016-03-26 20:52:14 +01:00
Yann Collet
b9151406de
fixed 32-bits compatibility
2016-03-26 17:18:11 +01:00
Yann Collet
a5b66e34c7
minor variable isolation
...
and remove a goto
2016-03-26 01:48:27 +01:00
Yann Collet
b58c685cf7
fixed : fullbench link to deprecate function (wrong prototype)
2016-03-25 20:29:35 +01:00
inikep
5553442376
fixed compilation with ZSTD_NOBENCH
2016-03-25 13:35:33 +01:00
Yann Collet
7cbe79ab25
fixed write overflow found by fuzzer
2016-03-23 22:31:57 +01:00
inikep
eaba91a161
added ZSTD_compressBegin_targetSrcSize
2016-03-23 20:30:26 +01:00
inikep
7adceef974
hashLog3 added to ZSTD_CCtx
2016-03-23 15:53:38 +01:00
inikep
472638c861
added mili_sleep and setHighPriority
2016-03-23 12:28:28 +01:00
Yann Collet
fd69225086
bench : added HIGH_PRIORTY
2016-03-23 02:47:33 +01:00
Yann Collet
be391438ff
first working version with both encoder and decode alternate LL + ML coding scheme.
...
decompression speed highly impacted
2016-03-22 23:19:28 +01:00
inikep
2872b6f01f
Merge remote-tracking branch 'refs/remotes/Cyan4973/dev060' into dev
...
# Conflicts:
# lib/zstd_compress.c
# programs/bench.c
2016-03-22 14:38:34 +01:00
Yann Collet
fadda6c875
first prototype with ML encoding scheme (but not yet decoding scheme)
2016-03-22 12:14:26 +01:00
Yann Collet
1dcf930f72
Merge branch 'dev060' into alternateLLcode
2016-03-22 00:29:57 +01:00
Yann Collet
5a854af006
Fixed #153 , reported by @thatsafunnyname
2016-03-22 00:22:50 +01:00
Yann Collet
5c71491a46
first working version with alternate LL codes
2016-03-21 02:23:34 +01:00
Yann Collet
6c62b7dfc8
support default LL distribution
2016-03-21 00:39:19 +01:00
Yann Collet
d64f435f63
handles litLength >= 65535
2016-03-21 00:07:42 +01:00
Yann Collet
597847a2ae
first emulation
2016-03-20 19:14:22 +01:00
Yann Collet
ecabfe3777
Improved index overflow protection
2016-03-20 16:20:06 +01:00
Yann Collet
de406eebcd
minor code refactor
2016-03-20 15:46:10 +01:00
Yann Collet
70e4577179
minor code refactoring
2016-03-19 18:08:32 +01:00
Yann Collet
0d9ce04cd5
minor refactoring
2016-03-19 13:21:08 +01:00
Yann Collet
546c9b1c02
minor refactoring
2016-03-19 12:47:52 +01:00
Yann Collet
d1d210f3fb
minor code refactor
2016-03-19 12:12:07 +01:00
Yann Collet
f3120413cc
Fixed : decoder error on erroneous data
2016-03-19 11:40:19 +01:00
Yann Collet
1d1ae40258
bench.c : implemented single pass mode -i0
2016-03-17 19:51:02 +01:00
Yann Collet
699b14db1b
bench : changed timer to clock_t, reduced timeloop to 1sec
2016-03-17 19:37:33 +01:00
Yann Collet
512220a82f
fullbench : restored -b31 (decodeLiterals) and -b32 (decodeSeqHeaders)
2016-03-17 16:42:16 +01:00
Yann Collet
cdabd4a2a6
switched fullbench time measurement to clock_t from <time.h>
2016-03-17 16:18:36 +01:00
Yann Collet
31922d7931
Added : ability to test direct-streaming functions ZSTD_compressContinue() and ZSTD_decompressContinue()
2016-03-16 16:05:18 +01:00
Yann Collet
569b81adb1
changed BLOCKSIZE into ZSTD_BLOCKSIZE_MAX
2016-03-16 15:26:51 +01:00
Yann Collet
69afc716d3
minor refactoring, from char* to const char*
2016-03-15 21:44:39 +01:00
Yann Collet
f141eaa211
fullbench : ZSTD_decompress is now option 2
2016-03-15 21:13:52 +01:00
Yann Collet
34b20ec2c6
fullbench can measure speed of zbuff
2016-03-15 20:47:23 +01:00
Yann Collet
346bffbc68
Added frame content size test within fuzzer
2016-03-15 15:24:52 +01:00
Yann Collet
09b21ee2f6
fix fileio bug with new zbuff
...
simplified zbuff decoding
2016-03-15 12:56:03 +01:00
inikep
d700a1a8b9
ZSTD_setAdditionalParam
2016-03-15 12:18:44 +01:00
inikep
5fdd0b46d3
added additionalParam
2016-03-14 19:51:11 +01:00
Yann Collet
886274bc79
Merge pull request #147 from Cyan4973/dev
...
Decompression error return code, by @chipturner
2016-03-14 18:41:24 +01:00
inikep
e9554b73cc
-r# : test all compression levels from -bX to #
2016-03-14 18:10:30 +01:00
Yann Collet
97406c9b2c
Added test to check decompression error return code
2016-03-14 17:05:40 +01:00
inikep
44af12deb1
removed DEFAULT_CHUNKSIZE
2016-03-14 15:59:04 +01:00
Chip Turner
9da7f86591
use remove instead of unlink
2016-03-14 07:44:59 -07:00
inikep
c034b73f8f
benchResult_t changed to double
2016-03-14 13:13:42 +01:00
inikep
4e26bb69c7
bench.c can generate a log file with average values
2016-03-14 12:48:51 +01:00
Chip Turner
6de382cdbb
propagate errors when decompressing; also unlink dstfile if we create it but fail
...
to successfully compress or decompress
2016-03-13 22:33:11 -07:00
Yann Collet
27d3dad751
benchmark mode : automated cooling (overheat protection)
2016-03-11 13:41:20 +01:00
Yann Collet
8a1d1a6a6c
implemented --ultra mode protection
2016-03-10 21:02:25 +01:00
inikep
aff4ba1714
hashLog3 removed from paramgrill
2016-03-10 15:45:21 +01:00
Yann Collet
2e91dde43e
improved memory size evaluation by paramgrill
2016-03-08 12:22:11 +01:00
Yann Collet
dd54bbc184
Fixed large NbSeq > 32 K
...
Added a test in Fuzzer to check NbSeq > 32 K
2016-03-08 02:35:34 +01:00
Yann Collet
370b08e840
fix compression ratio for blocks <= 16 KB
2016-03-08 00:03:59 +01:00
Yann Collet
4ba85344e3
added test to generate lots of small sequences (3-bytes)
2016-03-07 20:01:45 +01:00
Yann Collet
4ec2998b1f
Added zeroes test ( #137 )
2016-03-04 19:09:28 +01:00
Yann Collet
a997654670
Merge pull request #136 from inikep/dev
...
merging mml3 mode
2016-03-01 17:31:03 +01:00
inikep
59493e8669
fixed paramgrill
2016-02-25 19:15:08 +01:00
Yann Collet
7de4f9fd81
minor cosmetic
2016-02-23 21:34:18 +01:00
Yann Collet
2cf6d662a8
fixed #131
2016-02-23 21:21:29 +01:00
Yann Collet
728c8fc995
longer pgo tests
2016-02-17 17:04:12 +01:00
Yann Collet
2673076b3d
fix zstd-frugal
2016-02-17 13:40:11 +01:00
Yann Collet
9abc358df6
added : test for too large CLevel
2016-02-16 16:35:28 +01:00
Yann Collet
6aa896adc6
zstd cli : control maximum compression level
2016-02-16 16:33:48 +01:00
Yann Collet
2d08b098ef
Updated man zstd
...
Added `-t` | `--test` to zstd cli
Added a few long commands, compatible with gzip
2016-02-16 14:42:08 +01:00
Yann Collet
459a6b712f
Fix corner case multiple files bug
...
Added test cases
2016-02-15 20:37:23 +01:00
Yann Collet
accfd80c37
Added : option -t to test compressed files integrity
2016-02-15 19:33:16 +01:00
Yann Collet
e93add0439
Removed if (matchIndex >= current) return 0; as recommended by @inikep
2016-02-15 17:44:14 +01:00
Yann Collet
cefef8cde7
Change : zstd_opt_bt => zstd_btopt
2016-02-15 07:21:54 +01:00
Yann Collet
8154c3d7e2
added simple one file test
2016-02-13 03:12:10 +01:00
Yann Collet
e8bd73df80
Fixed : error when compressing one file
2016-02-13 03:09:48 +01:00
Yann Collet
23e8aee224
Introduced new compression level settings
...
Changed position of parameter TargetLength
2016-02-13 02:08:46 +01:00
Yann Collet
6f3acbac0d
notificationLevel into ZDICT_param_t
2016-02-12 20:19:48 +01:00
Yann Collet
62ae5fb0d2
zstd_buffered => zbuff
2016-02-12 18:59:11 +01:00
Yann Collet
f4c9d75370
dictBuilder => zdict
2016-02-12 18:45:02 +01:00
Yann Collet
1f1f239ed9
zstd cli can decompress multiple files with no specific suffix condition into stdout
2016-02-12 18:33:26 +01:00
Yann Collet
f062436fa6
cli : added ability to compress multiple files into stdout (-c)
2016-02-12 15:56:46 +01:00
Yann Collet
492a9bb88e
fixed Valgrind tests
2016-02-12 03:52:37 +01:00
Yann Collet
883a67eee2
fixed cmake
2016-02-12 03:50:05 +01:00
Yann Collet
c8da2c9f8f
updated tests
2016-02-12 02:56:27 +01:00
Yann Collet
71eafdd23f
Integrated dictionary builder into zstd cli
2016-02-12 02:31:57 +01:00
Yann Collet
04b12d8bcb
paramgrill can select manually targetLength
...
new compression levels
2016-02-11 06:23:24 +01:00
Yann Collet
bd828d9cd1
changed : sufficientLength => targetLength
2016-02-11 04:38:55 +01:00
Yann Collet
4488661678
minor cosmetics
2016-02-11 04:17:50 +01:00
Yann Collet
b79a0b34f3
paramgrill supports sufficientLength
...
stronger variation for ZSTD_opt
2016-02-10 17:07:37 +01:00
Yann Collet
70e8c389f1
Refactoring for portability
2016-02-10 13:37:52 +01:00
Yann Collet
ee602ce68c
Added btlazy2 to short tests
2016-02-08 18:46:26 +01:00
Yann Collet
521b0108dd
Added PowerPC tests with Qemu user more
...
Shortened tests for emulated platforms
removed date from CLI for reproducibility
2016-02-08 01:27:59 +01:00
Yann Collet
648959a9ed
new : ARM tests with Qemu user-mode
2016-02-07 23:58:32 +01:00
Yann Collet
ef37063503
fix big-endian compression error
2016-02-07 03:53:12 +01:00
Yann Collet
45ff4309fd
Updated documentation
2016-02-05 15:24:57 +01:00
Yann Collet
464fa996e9
added v0.4 legacy support
2016-02-03 01:09:46 +01:00
Yann Collet
2ce4923238
modified buffer management rules
2016-02-02 14:36:49 +01:00
Yann Collet
e93d6ced17
minor compression gain
2016-01-31 00:58:06 +01:00
Yann Collet
fd416f1eaf
added : ZSTD_compress_usingPreparedCCtx()
2016-01-30 03:14:15 +01:00
Yann Collet
fb810d6053
changed dictionary format
2016-01-28 00:21:13 +01:00
Yann Collet
1c8e194297
modified streaming compression API
2016-01-26 16:31:22 +01:00
Yann Collet
7b51a2948f
modified streaming decompression API
2016-01-26 15:58:49 +01:00
Yann Collet
b923f65076
introduced dictionary format
2016-01-26 03:14:20 +01:00
Yann Collet
59d1f79768
variable litblock header size
2016-01-23 19:28:41 +01:00
Yann Collet
977f1f3600
modified error system, following suggestions by @nemequ
2016-01-21 15:38:47 +01:00
Yann Collet
03a6dab721
bench : more accurate block nb in error report
2016-01-21 02:21:17 +01:00
Yann Collet
1840d6af33
bench pay attention to variable block sizes
2016-01-20 15:39:06 +01:00
Yann Collet
2630a5eadc
benchmark uses ZSTD_duplicateCCtx()
2016-01-14 19:13:22 +01:00
Yann Collet
b012510d9f
dictionary with block API
2016-01-09 02:00:10 +01:00
Yann Collet
bf42c8e5d8
block-level API
2016-01-09 01:08:23 +01:00
Yann Collet
600962711d
added duplication tests
2016-01-08 17:27:50 +01:00
Yann Collet
ecd651bd91
added ZSTD_duplicateCCtx()
2016-01-07 15:35:18 +01:00
Yann Collet
1fdd82312d
Fixed : strict aliasing warnings in legacy decoders
2016-01-06 12:35:42 +01:00
Yann Collet
8ab94b653c
updated xxhash
2016-01-06 01:37:46 +01:00
Yann Collet
5835e1b5ba
updated xxhash source
2016-01-05 01:44:36 +01:00
Yann Collet
722504c2a0
update version to 0.4.6
2015-12-31 18:32:15 +01:00
Yann Collet
5f9f98768a
Makefile version automatically follows zstd.h
2015-12-30 19:52:08 +01:00
Yann Collet
c1450f721d
fix confirmation prompt
2015-12-29 11:57:15 +01:00
Yann Collet
324a3e27c3
fixed visual warning
2015-12-18 03:19:27 +01:00
Yann Collet
6a4583542a
fixed asan warning
2015-12-18 02:51:14 +01:00
Yann Collet
17d188fa38
robust file list
2015-12-18 02:14:46 +01:00
Yann Collet
31683c0b28
benchmark can use dictionary
2015-12-18 01:26:48 +01:00
Yann Collet
fdcad6d3e1
added ZSTD_compress_usingDict()
2015-12-17 23:50:15 +01:00
Yann Collet
035c5429ba
fix test32
2015-12-17 23:12:07 +01:00
Yann Collet
deb078b9b1
added : -m : decompress multiple files
2015-12-17 20:30:14 +01:00
Yann Collet
9d90922d49
refactored file compression
2015-12-17 14:09:55 +01:00
Yann Collet
24c98f2b4b
fixed : conversion warning
2015-12-17 02:48:26 +01:00
Yann Collet
4f13703b2f
added : -m : compress multiple files in a single command
2015-12-17 02:23:58 +01:00
Yann Collet
367060b874
larger cBuffer
2015-12-17 00:07:10 +01:00
Yann Collet
ad84ac9375
reduce memory usage
2015-12-16 03:57:46 +01:00
Yann Collet
880486ff05
fix g++ warning
2015-12-16 03:37:21 +01:00
Yann Collet
a52c98d23a
fix Visual warning
2015-12-16 03:12:31 +01:00
Yann Collet
7061135d33
faster init for multi-files bench
2015-12-16 03:01:03 +01:00
Yann Collet
6c8b925ab9
fixed Visual warning
2015-12-16 02:44:56 +01:00
Yann Collet
ed699e692d
benchmark multiple files
2015-12-16 02:37:24 +01:00
Yann Collet
7a3ab588c7
minor fixes
2015-12-15 11:25:12 +01:00
Yann Collet
397f1ffd52
fixed test script
2015-12-13 14:05:00 +01:00
Yann Collet
5d4fa0ed9b
fixed arm-specific shadow warning
2015-12-13 13:58:51 +01:00
Yann Collet
60348b91f3
fixed silent conversion warnings
2015-12-13 13:44:23 +01:00
Yann Collet
f6f3d7526a
external dictionary capability added to command line
2015-12-13 13:35:21 +01:00
Yann Collet
3a061a4c9f
extended static dictionary to buffered mode
2015-12-12 11:17:42 +01:00
Yann Collet
6c3e2e7855
fixed : high compression modes for Windows 32 bits
2015-12-11 10:44:07 +01:00
Yann Collet
695a6cb463
fixed #94
2015-12-10 15:51:38 +01:00
Konstantin Tokarev
2b465840a8
Re-added accidentally lost round-trip tests for compression levels > 12.
2015-12-08 19:36:42 +03:00
Konstantin Tokarev
0b570b59d2
playTests.sh: Added --test-large-data switch.
2015-12-08 18:47:43 +03:00
Konstantin Tokarev
76be378513
playTests.sh: refactored round-trip tests
2015-12-08 18:36:37 +03:00
Konstantin Tokarev
d66db2ff04
Move tests from zstd-playTests target to separate shell script.
...
This patch allows me to run tests on MIPS board which lacks make.
2015-12-08 18:11:10 +03:00
Yann Collet
4bfe415fa7
validated external dictionary
2015-12-06 13:18:37 +01:00
Yann Collet
e47c4e5f8e
strengthened bufferless streaming decompression
2015-12-05 09:23:53 +01:00
Yann Collet
1c2ddba469
use time limited fuzzer tests in CI
2015-12-04 17:45:35 +01:00
Yann Collet
553cf6a926
time-limited fuzzer tests
2015-12-04 17:25:26 +01:00
Yann Collet
417890cec2
strengthened streaming bufferless compression
2015-12-04 17:16:37 +01:00
Yann Collet
28e7cefea9
new zstd-noBench & zstd-frugal builds
2015-12-03 12:11:30 +01:00
Yann Collet
6a2f03295c
update version to 0.4.2
2015-12-02 15:05:22 +01:00
Yann Collet
a9b34280a1
minor cosmetic improvement for small blocks
2015-12-02 13:00:25 +01:00
Yann Collet
c620b48489
revert install to normal zstd due to travis limitation (likely gcc 4.6)
2015-12-01 01:56:02 +01:00
Yann Collet
d062f1379c
fixed benchmark autogen
2015-12-01 01:31:17 +01:00
Yann Collet
0338635e93
pgo
2015-12-01 01:28:32 +01:00
Yann Collet
aead1bf86b
changed to ZSTD_LEGACY_SUPPORT=0, as suggested within #80
2015-11-30 14:18:47 +01:00
Yann Collet
a85a8dd94a
Fixed #80 (reported by @luben)
...
Added : tests for ZSTD_LEGACY=disable build mode
extended ZSTD_LEGACY=disable to dll build
2015-11-30 11:53:11 +01:00
Yann Collet
7fe531e7ec
fixed address space overflow (32-bits mode)
2015-11-29 02:38:09 +01:00
Yann Collet
00fd7a2110
protect 32-bits mode
2015-11-28 16:03:22 +01:00
Yann Collet
49cc9b7d03
large file support
2015-11-27 17:52:57 +01:00
Yann Collet
09116c2e4d
optimizer mode
2015-11-27 17:46:14 +01:00
Yann Collet
b096cbf0d2
can build without legacy support using ZSTD_LEGACY=disable
2015-11-27 16:18:56 +01:00
Yann Collet
800fa6c378
stronger tests for zbuff decompression
2015-11-27 14:30:23 +01:00
Yann Collet
31d1806a77
zbuff properly supports small dst buffers
2015-11-27 14:07:36 +01:00
Yann Collet
29a2c838c5
support for legacy 0.3 format
2015-11-26 16:02:04 +01:00
Yann Collet
661f843637
fixed test in zbufftest
2015-11-26 15:39:44 +01:00
Yann Collet
26415d3ff2
fixed leak
2015-11-26 12:43:28 +01:00
Yann Collet
6bcdeac954
fixed asan warning
2015-11-26 11:43:00 +01:00
Yann Collet
7447ee96f6
fixed g++ warning
2015-11-26 10:52:30 +01:00
Yann Collet
5f2ec63852
fixed decompression bug (buffered mode)
2015-11-26 10:32:17 +01:00
Yann Collet
91a97960f7
Added zbufftest
2015-11-26 09:59:49 +01:00
Yann Collet
d3cb690156
fixed leak issue
2015-11-25 15:26:55 +01:00
Yann Collet
785b5ecc54
stronger tests
2015-11-25 15:16:19 +01:00
Yann Collet
88fcd2916e
Added : zstd buffered API
2015-11-25 14:42:45 +01:00
Yann Collet
b5d2a0c827
visual compatibility
2015-11-23 17:10:19 +01:00
Yann Collet
225179dd05
more tests (bt modes)
2015-11-23 16:52:22 +01:00
Yann Collet
d7233d6e14
more compression tests
2015-11-22 14:40:51 +01:00
Yann Collet
a5c737411a
complex level selector
2015-11-22 14:16:56 +01:00
Yann Collet
402fdcf1a3
fixed asan
2015-11-20 12:46:08 +01:00
Yann Collet
6a11a69b15
added : repcode generation to datagen
2015-11-20 12:00:25 +01:00
Yann Collet
dc5e3e96f8
minor memsave
2015-11-20 09:23:56 +01:00
Yann Collet
110cc14bab
fixed bug #73 notified by @nemequ
2015-11-19 12:02:28 +01:00
Yann Collet
b2549846ba
more tests
2015-11-18 11:29:32 +01:00
Yann Collet
2666d3e56c
more tests
2015-11-14 11:07:51 +01:00
Yann Collet
93a823ccb7
fixed asan warnings
2015-11-13 15:08:43 +01:00
Yann Collet
0f366c61ed
fixed streaming decoder
2015-11-12 16:19:30 +01:00
Yann Collet
cfdeb34180
fixed g++ link error
2015-11-12 16:00:04 +01:00
Yann Collet
7f6e91fa98
fixed library compilation
2015-11-11 14:39:50 +01:00
Yann Collet
5be2dd25f2
Changed Library source tree
...
- no more zstdhc ; zstd.h is enough
- ZSTD_compress() now needs a compressionLevel
- separated zstd_compress.c and zstd_decompress.c
- updated zstdcli, fullbench, fuzzer with new API
2015-11-11 13:43:58 +01:00
Yann Collet
b7d6e8f6bc
fixed Visual warning
2015-11-09 18:20:39 +01:00
Yann Collet
9f432926b4
fileio can use small blocks params
2015-11-09 17:42:17 +01:00
Yann Collet
43e0cd512a
small blocks params
2015-11-09 16:38:17 +01:00
Yann Collet
7ccff59cb3
fold fast stats
2015-11-09 12:07:44 +01:00
Yann Collet
6d2c9e6c62
generic param table
2015-11-09 11:39:48 +01:00
Yann Collet
d61ddd03ec
pg display CL-compatible params
2015-11-08 14:45:38 +01:00
Yann Collet
4c7aae3a36
fuzzer tests more HC levels
2015-11-08 14:24:59 +01:00
Yann Collet
f48e35c206
minor bt improvements
2015-11-07 01:13:31 +01:00
Yann Collet
acd222c82e
update readme
2015-11-06 12:39:39 +01:00
Yann Collet
444873f494
minor greedy mod
2015-11-06 11:48:56 +01:00
Yann Collet
f12c1304a8
integrate fast mode
2015-11-05 18:16:59 +01:00
Yann Collet
1f44b3f778
added fast mode
2015-11-05 17:32:18 +01:00
Yann Collet
47b68908b2
rename lazy2
2015-11-05 15:14:17 +01:00
Yann Collet
5106a76dc9
merged strats
2015-11-05 15:00:24 +01:00
Yann Collet
50c5cdb44c
fixed issues reported by Maciej Adamczyk
2015-11-04 20:35:33 +01:00
Yann Collet
3e3582719c
Fixed issue #62 , reported by @luben
2015-11-04 18:19:39 +01:00
Yann Collet
2c7ac7c055
fix bench on /dev/null
2015-11-04 17:52:18 +01:00
Yann Collet
b241e9deb7
small compression improvement
2015-11-04 13:57:24 +01:00
Yann Collet
59d7063fbc
fix and level tuning
2015-11-04 12:05:27 +01:00
Yann Collet
96b9f0ba4d
btlazy2
2015-11-04 03:52:54 +01:00
Yann Collet
293d0cc261
fixed Visual warning
2015-11-03 13:10:25 +01:00
Yann Collet
cdc2b2f758
fixed clang warning
2015-11-03 10:52:14 +01:00
Yann Collet
050efba81b
level tuning
2015-11-03 09:49:30 +01:00
Yann Collet
3564487614
lazydeep
2015-11-02 16:14:46 +01:00
Yann Collet
7671f393be
v0.3.2
2015-11-02 12:17:39 +01:00
Yann Collet
66d22b803b
v0.3.1
2015-11-02 02:36:10 +01:00
Yann Collet
21f96934c3
fixed config counter
2015-11-01 14:32:59 +01:00
Yann Collet
9b11b46f8a
Fixed speed regression
2015-11-01 12:40:22 +01:00
Yann Collet
be2010ea1b
lazy strategy
2015-10-31 12:57:14 +01:00
Yann Collet
4b100f43b0
level tuning
2015-10-30 15:49:48 +01:00
Yann Collet
aa074051d6
decoding support for legacy v0.2 format
2015-10-30 11:21:50 +01:00
Yann Collet
fc04bcc6d7
fixed minor gcc warning
2015-10-30 07:11:07 +01:00
Yann Collet
4114f95ce9
fix Visual Studio projects
2015-10-30 06:40:22 +01:00
Yann Collet
f8eaf0e158
added HC tests
2015-10-30 05:59:18 +01:00
Yann Collet
44fe99116e
fixed hc alloc
2015-10-29 22:02:40 +01:00
Yann Collet
c776c46b46
range bench
2015-10-29 19:10:54 +01:00
Yann Collet
2f648e54ff
hc fuzzer tests
2015-10-29 18:23:38 +01:00
Yann Collet
71bcdb5c1f
sync paramgrill with HC starting at level 2
2015-10-29 17:08:03 +01:00
Yann Collet
2acb5d3d48
HC modes can be selected from command line
2015-10-29 16:49:43 +01:00
Yann Collet
76c5c2a4a0
minor tuning
2015-10-28 19:07:05 +01:00
Yann Collet
81e49e6654
fine tune & messages
2015-10-28 15:56:48 +01:00
Yann Collet
10ba1834cc
value time
2015-10-28 14:05:37 +01:00
Yann Collet
1077bb8141
memory notation
2015-10-28 12:32:25 +01:00
Yann Collet
b315bc86e1
srcLog
2015-10-27 13:12:25 +01:00
Yann Collet
2c6992e1dc
blocksize & T
2015-10-27 12:18:00 +01:00
Yann Collet
8b91abec18
can test param conf
2015-10-27 02:59:12 +01:00
Yann Collet
786f5b554a
skip slow conf faster
2015-10-26 15:45:58 +01:00
Yann Collet
b2ad30cea2
faster scan
2015-10-26 02:45:19 +01:00
Yann Collet
0b87939dc0
clean paramgrill
2015-10-26 00:11:16 +01:00
Yann Collet
78d0f39605
make paramgrill
2015-10-26 00:07:32 +01:00
Yann Collet
fd9d6b8e2f
paramgrill
2015-10-26 00:06:36 +01:00
Yann Collet
83fae977e6
Added asan tests
2015-10-23 15:21:53 +01:00
Yann Collet
eeb8ba18d1
uncoupled maxdlog and chainlog
2015-10-22 16:55:40 +01:00
Yann Collet
f3eca25322
quick first zstdhc version
2015-10-22 15:31:46 +01:00
Yann Collet
353c5d26cf
unified ctx naming convention
2015-10-21 14:39:26 +01:00
Yann Collet
1c00dc3e24
Added block size to bench
2015-10-21 08:22:25 +01:00
Yann Collet
07e0674007
Fixed fullbench
2015-10-19 20:02:46 +01:00
Yann Collet
b1f3f4b565
update huff0
2015-10-18 22:18:32 +01:00
Yann Collet
0fef5be1cc
Fix fullbench
2015-10-14 18:07:24 +01:00
Yann Collet
be50aaa0ee
Added : Frame concatenation ability
2015-09-10 23:26:09 +01:00
Yann Collet
5abd8203cb
Fix : decompression i/o detects flush write errors
2015-08-27 03:16:04 +01:00
Yann Collet
352ab88aea
fixed minor issue on decoding invalid data
2015-08-26 22:45:23 +01:00
Yann Collet
ddf39e91c5
modified man page
2015-08-26 12:04:58 +02:00
Yann Collet
50b6f941e8
added : --verbose command
2015-08-26 10:32:17 +01:00
Yann Collet
bf50409e05
Refactor Makefile and .travis tests
2015-08-26 00:19:06 +01:00
Yann Collet
f44b2b02b4
Zstd cli : --version and --help write to stdout
2015-08-25 23:32:45 +01:00
Yann Collet
61d08c52a5
More informative write error messages
2015-08-25 18:13:32 +01:00
Yann Collet
5b147600f9
Fixed #42
2015-08-25 17:41:46 +01:00
Yann Collet
1885029ba1
Fixed a few issues found by AFL (American Fuzzy Lop)
2015-08-24 20:17:11 +01:00
Yann Collet
fee8e240c7
Fixed decoding error #11 (reported by @magv)
2015-08-24 15:47:04 +01:00
Yann Collet
d5d9bc3f82
Added : ZSTD decompression : ability to resist to noisy/faulty data source
2015-08-23 23:13:49 +01:00
Yann Collet
cf5ce55cca
Updated xxhash
2015-08-21 12:00:52 +01:00
Yann Collet
997f9ee2ef
Added : fuzzer tests : decompressing noisy src
2015-08-21 02:44:20 +01:00
Yann Collet
602834f794
Fixed : bug in compression in specific conditions (too small dst size)
2015-08-20 07:46:10 +01:00
Yann Collet
f3cb79b58f
Fixed : g++ link error within fullbench
2015-08-20 00:02:43 +01:00
Yann Collet
f4ce8913a3
Added more strigent tests : compresson into too small buffer
2015-08-11 14:18:45 +01:00
Yann Collet
bd8f4e0e5c
added : .gitignore generated binaries
2015-08-10 18:02:52 +01:00
Yann Collet
e9853b2cdb
Fixed : ZSTD_compress() can attempt compression on a too small buffer
2015-08-07 19:07:32 +01:00
Yann Collet
e8c6bb1e42
Integrated huff0 (breaking format change)
2015-07-26 00:23:57 +01:00
Yann Collet
8b48b24821
Fixed minor visual analyzer warning
2015-07-07 17:26:17 -08:00
Yann Collet
674d91b3da
Added sanitize=undefine test
2015-07-07 00:36:49 -08:00
Yann Collet
17867ced03
Fixed minor clang warnings
2015-07-07 00:14:27 -08:00
Yann Collet
7083b8a54a
Travis CI : added ARM compilation tests
2015-07-06 23:58:59 -08:00
Yann Collet
effbd9811b
Merge pull request #30 from jforberg/dev
...
Add `unzstd` program for decompression.
2015-07-05 15:02:41 -07:00
Yann Collet
b5e06dc7c3
Fixed a few minor visual analyzer warnings
2015-07-04 23:20:56 -08:00
Yann Collet
94f998b1fc
Fixed a few visual analyzer warnings
2015-07-04 23:10:40 -08:00
Yann Collet
7393c5a51d
Advanced API change : Cctx & DCtx are now incomplete types for stricter type checking
2015-07-04 18:20:42 -08:00
Yann Collet
14c6d0db9f
updated xxhash version
2015-07-04 18:14:14 -08:00
Yann Collet
b6a0072699
Updated Visual projects
2015-07-04 16:23:52 -08:00
Yann Collet
1efa31fad8
Updated FSE lib
2015-07-04 15:56:41 -08:00
Yann Collet
078a9a2804
Added Wcast-qual compilation flag
...
Updated xxHash
Removed log traces
2015-06-20 19:37:53 -08:00
Yann Collet
213089c078
Updated FSE
...
Added clang and g++ tests
2015-06-18 07:43:16 -08:00
Johan Förberg
273d049a7c
Add unzstd program for decompression.
2015-03-24 20:15:56 +01:00
Yann Collet
1d62914ea7
Added : valgrind test for datagen
2015-03-09 13:48:34 +01:00
Yann Collet
5203b8c68d
Updated datagen : sparse file generation
2015-03-09 13:17:36 +01:00
Yann Collet
c5d46b5c90
New streaming API behavior, to solve issue 19 ( https://github.com/Cyan4973/zstd/issues/19 )
2015-02-16 18:06:26 +01:00
Yann Collet
f66d2babf8
Updated test-fullbench
2015-02-11 08:34:50 +01:00
Yann Collet
f96780683b
updated fullbench, to include datagen
2015-02-11 08:19:57 +01:00
Yann Collet
fb98fd0bd4
datagen refactoring
2015-02-10 18:15:20 +01:00
Yann Collet
6610cb381c
datagen is now a library, to be included in multiple programs
2015-02-09 08:00:26 +01:00
Yann Collet
aacace37f7
Fixed a few clang warnings
2015-02-01 11:57:30 +01:00
Yann Collet
439eb77088
Normalize all the line endings
2015-01-31 10:52:59 +01:00
Yann Collet
6434adcf54
Fix : no AVX2 for Visual 2008 and older
2015-01-29 07:00:43 +01:00
Yann Collet
e1e6f7d0b1
Removed minor warnings under minGW
2015-01-25 15:50:24 +01:00
Yann Collet
759433d679
Updated fullbench tests
2015-01-24 13:31:55 +01:00
Yann Collet
18a68714d0
Fixed : issue within fullbench, reported by AJ Baxter
2015-01-24 12:08:52 +01:00
Yann Collet
04d8e15e57
fixed : file permissions
2015-01-24 11:22:13 +01:00
Yann Collet
4856a00164
Initial release
2015-01-24 01:58:16 +01:00
