v0.34.3

Release v0.34.3

• Mitigate risks of SoftReference cache OOM (#5520)
• Fixed excessive memory usage when reading parquet (#5516)
• Added fix for NPE when reading from S3 (#5514)
• Added support for reading Parquet V2 pages (#5508)

Full Changelog: v0.34.2...v0.34.3

v0.34.2

671a9f6 Improve FileUtils.deleteRecursively diagnostics. (#5430)
d0ddd90 Add java-client support for primitive array types (#5494)
a550c4f Factory for Vectors over entire columns from a Table (#5506)
58c8337 Fix JS API reconnecting with failed tables (#5501)
59de583 Force PartitionAwareSourceTable to coalesce whenever a partition filter is applied via where (#5485)
02b11bf Fixed the parquet uint32 reading failure (#5495)
1316717 Small ring chunk source cleanup (#5502)
0ece8ef Barrage Ingestion: Fix ClassCastExceptions on Empty Primitive Arrays (#5503)
19654e7 Move away from ClientMiddleware and ClientAuthHandler in pydeephaven (#5489)
68b228e Update web version 0.78.0 (#5500)
9ed25ef [create-pull-request] automated change (#5463)
b05fda5 Bugfix in URI conversion when working with directories (#5493)
1c215c2 Free performance data when ExportObject is released (#5480)
e29287a Implement DisplayWrapper#hashCode to fix SelectDistinct Behavior (#5281)
69378ea Don't close long-lived RowSets in Downsampler BucketState (#5478)
25d097a Publish deephaven-server-test-utils jar (#5467)
b3d1d61 Barrage Ingestion: Support TimeUnit Conversion on Instant and ZonedDateTime Columns (#5488)
61a11f4 Added a soft-reference based shared cache for S3 reads (#5357)
db65c7c Fix a numpy/seq incompatibility bug in 3.8 (#5466)
f33000c Fix for NPE on first update cycle when using (Sorted|Unsorted)ClockFilter on an empty Table (#5474)
4554c4b Improved threading capabilities of S3+parquet (#5451)
519682e Added S3 test tools to help with directory uploading (#5442)
b8448a6 Make DataIndex accumulation and transformation parallelizable (#5457)

Full Changelog: v0.34.1...v0.34.2

v0.34.1

c33218a Arrow Encoding for LocalDate and LocalTime (#5446)
c98f997 Add logging when a ReplayTableBase has an error during refresh (#5454)
061943d Update web version 0.76.0 (#5452)
169d4eb Test for null result in DataIndexer.getOptimalPartialIndex (#5449)
93d9268 Update web version 0.75.1 (#5448)
9928db0 Fix SQL ArrayType / CustomType failure mode (#5445)
ed7d643 JS API should return nulls rather than undefined when reading table data (#5437)
c544222 Collect all pydeephaven-ticking wheels into single directory (#5444)
41a93da Update web version 0.75.0 (#5439)
482388e Move Script Cache Clearing to Dagger (#5436)
af8847a Parallelize TableLocation creation and address some interface cleanups (#5432)
67d1b4f fix: Could not re-open application created variables (#5435)

Full Changelog: v0.34.0...v0.34.1

v0.34.0

What's Changed

• Post release bump to 0.34.0-SNAPSHOT by @devinrsmith in #5173
• Add "runtime" / "development" scopes to dependency submission by @devinrsmith in #5174
• Bump commons-compress to 1.26.0 by @devinrsmith in #5178
• Add optional S3 dependency to py embedded-server by @devinrsmith in #5180
• Bump to confluent version 7.6.0 by @devinrsmith in #5179
• Bump calcite to 1.36.0, add json-path constraint by @devinrsmith in #5181
• Make 'numba' a soft dependency for the Python server API by @jmao-denver in #5169
• Remove old benchmark script by @devinrsmith in #5187
• Update publish-ci to continue on certain failures by @devinrsmith in #5191
• Quiesce RetainedRefrenceTracker#ensureReferencesDroppedInternal by Disabling CLEANUP_LOG_ENABLED by Default by @nbauernfeind in #5188
• Added support to read mixed encoded parquet files by @malhotrashivam in #5176
• More helpful error when UDF arg type check failed by @jmao-denver in #5175
• Update to Gradle 8.6, fix most warnings for Gradle 9 by @niloc132 in #4693
• Fixed a bug in managing context objects by @malhotrashivam in #5195
• Update gradle checksum to match the documented value by @niloc132 in #5198
• Added py.typed marker for deephaven by @bierus in #5196
• Fix learn NPE by @alexpeters1208 in #5201
• Update web version 0.66.0 by @github-actions in #5202
• Provide upperBin and lowerBin signatures that accept Durations by @chipkent in #5148
• Support use of DType instances in Py UDF annotations by @jmao-denver in #5200
• Bump to jetty 11.0.20 by @devinrsmith in #5203
• Improve WindowCheck memory usage. by @cpwright in #5197
• Update web version 0.66.1 by @github-actions in #5205
• Fix bugs in moveColumns and renameColumns by @nbauernfeind in #5193
• Fix the hyperlink to the ticking readme by @jmao-denver in #5211
• Reduce memory footprint in UpdateBy rolling time operatations by @lbooker42 in #5215
• Address Blink table usage of i, ii, k, and column arrays; address improper memoization sharing between blink and non-blink table copies by @rcaudy in #5216
• Update web version 0.67.0 by @github-actions in #5218
• Update docs issue autogeneration to point to new docs repo by @mattrunyon in #5219
• build: Add provenence flag when publishing jsapi-types by @mofojed in #5204
• eval string annotation with func's globals by @jmao-denver in #5227
• Automate file headers by @niloc132 in #5207
• Update and automate file headers by @niloc132 in #5208
• fix: Mark JsPartitionedTable.getTable as nullable by @mofojed in #5050
• Bump test startup timeout dramatically to stop seeing this failure by @niloc132 in #5228
• Fix Python 3.8 compatibility issue by @jmao-denver in #5235
• Dramatically increase timeout for another part of failing test by @niloc132 in #5237
• Update web version 0.68.0 by @github-actions in #5239
• Check for empty data for add/delete/+async on InputTable by @jmao-denver in #5242
• Generalize Python InputTable class by @arman-ddl in #5236
• Added fix for File.toURI regression by @malhotrashivam in #5247
• Update web version 0.69.0 by @github-actions in #5257
• Make column_to_numpy_array private by @jmao-denver in #5256
• Update web version 0.69.1 by @github-actions in #5259
• Add SafeCloseable context manager wrapper by @arman-ddl in #5251
• docs: remove the original doc-ci.yml action as it's output is now unused by @dsmmcken in #5250
• Make python timezone conversions handle more cases by @chipkent in #5249
• Make time of day methods handle daylight savings time (DST) better by @chipkent in #5245
• Provide query library functions for computing differences and sort order by @chipkent in #5151
• Port DH-11168: Indexing enhancements to Community. by @lbooker42 in #3851
• Python Client: add instructions that set DEEPHAVEN_VERSION by @kosak in #5006
• Only support zoneinfo for python 3.9+ by @chipkent in #5271
• Adds a quick CI job to verify python minimum version by @devinrsmith in #5272
• Use AutoCloseable in some places where we previously used SafeCloseable, and standardize some SafeCloseable utilities by @rcaudy in #5274
• Fix input table jpy restriction by @arman-ddl in #5260
• Bump server base images, jpy>=0.16.0 by @devinrsmith in #5273
• Update web version 0.70.0 by @github-actions in #5276
• C++ client: make sure that the select test covers all types by @kosak in #5284
• C++ Client: fix FillChunk and missing types for ticking callbacks by @kosak in #5286
• C++ client: process Barrage shifts properly by @kosak in #5285
• Python ticking client: if no Barrage metadata, pass NULL to C++ handler by @kosak in #5283
• Check arg type against Py UDF signature at query compile time by @jmao-denver in #5254
• Allow for specifying extra class paths to embedded server. by @supernomad in #5282
• Bump to gradle 8.7 by @devinrsmith in #5287
• Build py-ticking wheel using docker on top of a manylinux base image. by @jcferretti in #5267
• Improve DynamicWhereFilter performance by @rcaudy in #5293
• Bump peter-evans/create-pull-request from 5 to 6 by @dependabot in #5113
• Improve set inclusion kernel performance by @lbooker42 in #5300
• C++ client: delete stray debug code by @kosak in #5301
• RspRowSequence and SortedRangesRowSequence should invalidate their RowSequenceAsChunkImpl on reset instead of closing it by @rcaudy in #5302
• Bump slackapi/slack-github-action from 1.24.0 to 1.25.0 by @dependabot in #5080
• Update web version 0.71.0 by @github-actions in #5303
• Bump base images by @devinrsmith in #5307
• Support numpy_nullable in to_pandas() by only checking Pandas version when 'pyarrow' is used by @jmao-denver in #5312
• Add java 22 nightly testing by @devinrsmith in #5313
• fix: Use correct schema when opening transformed partitioned tables by @mofojed in #5305
• Added support to write metadata files in parquet by @malhotrashivam in #5105
• Disable frequently timing-out test by @niloc132 in #5314
• Wrap the new data indexing feature in Python by @jmao-denver in #5306
• Introduce TableUpdateImpl copy that takes an MCS by @devinrsmith in #5319
• Upgrade to docker compose v2 by @devinrsmith in https...

v0.33.3

Patch release v0.33.3

• feat(embedded-server): Allow for specifying extra_classpaths on startup of the embedded server. (#5282)
• Build py-ticking wheel using docker on top of a manylinux base image. (#5267)
• Python ticking: if no Barrage metadata, pass NULL to C++ handler (#5283)
• C++ client: process Barrage shifts properly (#5285)
• C++ Client: fix FillChunk and missing types for ticking callbacks (#5286)
• C++ client: make sure that the select test covers all types (#5284)
• Only support zoneinfo for python 3.9+ (#5271)
• Make python timezone conversions handle more cases (#5249)
• Python Client: add instructions that set DEEPHAVEN_VERSION (#5006)
• Make time of day methods handle daylight savings time (DST) better (#5245)
• Added utils for converting File and Path to URI (#5247)
• Provide upperBin and lowerBin signatures that accept Durations (#5148)

Full Changelog: v0.33.2...v0.33.3

v0.33.2

v0.33.2 patch release with bug fixes.

• Check for empty data for add/delete/+async (#5242)
• Generalize Python InputTable class (#5236)
• Update web version 0.68.0 (#5239)
• Update web version 0.67.0 (#5218)
• Update web version 0.66.1 (#5205)
• Update web version 0.66.0 (#5202)
• Fix Python 3.8 compatibility issue (#5235)
• eval string annotation with fn's globals (#5227)
• Address Blink table usage of i, ii, k, and column arrays; address improper memoization sharing between blink and non-blink table copies (#5216)
• Reduce memory usage by using a temporary context. (#5215)
• Fix bugs in moveColumns and renameColumns (#5193)
• Improve WindowCheck memory usage. (#5197)

Full Changelog: v0.33.1...v0.33.2

v0.33.1

84264a5 Bump to 0.33.1
6e48391 Support use of DType instance in UDF annotation (#5200)
4698b9f Fix learn dependency issue (#5201)
589eaae Added py.typed marker for deephaven (#5196)
c4053f0 Added fix for managing context objects (#5195)
63e383e More helpful error when UDF arg type check failed (#5175)
aac191f Added support to read mixed encoded parquet files (#5176)
cd27d4d Update publish-ci to continue on certain failures (#5191)
21e39dc Make 'numba' a soft dependency for the Python server API (#5169)
3fb6fd8 Add optional S3 dependency to py embedded-server (#5180)

Full Changelog: v0.33.0...v0.33.1

v0.33.0

What's Changed

• Run JS API unit tests and integration tests in the Gradle build by @niloc132 in #4988
• Post release bump to 0.33.0 by @stanbrub in #5049
• JS API should expose if a table is refreshing by @niloc132 in #4999
• Eliminate Double Error Notifications in jsapi and Error Log by @nbauernfeind in #5048
• Extract qst-type from qst by @devinrsmith in #5054
• Refactor TypedFunction, ObjectProcessor, and ObjectProcessorFunctions by @devinrsmith in #4992
• Increase GWT test timeouts to avoid CI timeouts by @niloc132 in #5057
• Chunk pools should be easier to emulate in GWT by @niloc132 in #5053
• Extract variable api from ScriptSession, let ScriptSession guard reads by @niloc132 in #4970
• Go Client: Rewrite TestAsOfJoinQuery in query_test.go by @kosak in #5059
• Re-implement ParallelWhere using JobScheduler semantics. by @lbooker42 in #5032
• Add a local copy of build-dependencies.sh for cpp-client, and add a PR check that is kept up to date. by @jcferretti in #5072
• Fix Where performance regression by @lbooker42 in #5074
• Use a Deque to avoid StackOverflow in ImmediateJobScheduler by @nbauernfeind in #5077
• Update web version 0.60.0 by @github-actions in #5078
• Added support to read single parquet file hosted in AWS S3 by @malhotrashivam in #4972
• Fixed a parquet python module failure when s3 extension is not included by @malhotrashivam in #5092
• Fix ReadableByteChannel.read usages by @devinrsmith in #5089
• Submit gradle-aware dependency information to Github by @devinrsmith in #5086
• Update slf4j and logback versions by @devinrsmith in #5102
• Bump commons-compress by @devinrsmith in #5108
• Fixed a bug in reading metadata files by @malhotrashivam in #5103
• Increase one more failing test timeout by @niloc132 in #5098
• Update web version 0.61.0 by @github-actions in #5099
• Fix S3ChannelContext.FragmentState#cancelAndRelease by @devinrsmith in #5095
• Update avro version by @devinrsmith in #5104
• Update xerial snappy-java version by @devinrsmith in #5106
• Bump postgresql version by @devinrsmith in #5107
• Update web version 0.61.1 by @github-actions in #5111
• Add Py version check for using eval_str flag of the inspect.signature() by @jmao-denver in #5083
• Update web version 0.62.0 by @github-actions in #5114
• DEEPHAVEN_VERSION must be set when installing py-client wheel by @niloc132 in #5110
• Add support of 1D arrays in UDF vectorization by @jmao-denver in #5100
• Ensure wildcard imports work against JRE classes by @niloc132 in #5117
• Add endpointOverride S3 support by @devinrsmith in #5087
• Update web version 0.63.0 by @github-actions in #5126
• Add AggWAvg support for rollup() by @lbooker42 in #5121
• Propagate Blink Attribute Downstream of View/UpdateView/Select/UpdateView by @nbauernfeind in #5125
• Bump base image, update numba cutoff to Python 3.12 by @devinrsmith in #5130
• Increase another failing test timeout by @niloc132 in #5134
• Replace usage of trove in Chunk APIs by @niloc132 in #5058
• Deploy @deephaven/jsapi-types during release, provide tools for nightly builds by @niloc132 in #4907
• Reduce public visibility into io.deephaven.parquet.base by @devinrsmith in #5093
• Add RollingFormula feature to UpdateBy by @lbooker42 in #5085
• PythonScopeJpyImpl: Disable Conversion Cache by @nbauernfeind in #5123
• Fix unrendered HTML in py client doc by @jjbrosnan in #5149
• Ensure docs invokes typedoc with correct properties by @devinrsmith in #5146
• Improve S3, parquet, and SeekableChannelsProvider by @devinrsmith in #5137
• Reduce Verbose Logging in Generators by @nbauernfeind in #5155
• Clarify responsibilities when calling this method by @niloc132 in #5152
• Add TrustCustom by @devinrsmith in #5141
• Update web version 0.64.0 by @github-actions in #5156
• Add exception for exponential operators providing non-descending timestamps. by @lbooker42 in #5144
• GRPC support for MultiJoin, improved support for RangeJoin by @lbooker42 in #5153
• Drop Usage of ensureGil from PythonDeephavenSession and Copy Current Scope by @nbauernfeind in #5145
• Introduce TableInitializationException to Propagate JobScheduler Failures by @nbauernfeind in #5165
• When Sorting with a Static Symbol Table use a RowKey or RowPosition ColumnSource by @nbauernfeind in #5154
• Fix test failures from wrapping job scheduler errors in TableInitializationExceptions by @nbauernfeind in #5166
• Use reader's schema for kafka avro deserialization by @devinrsmith in #5167
• Update web version 0.65.0 by @github-actions in #5172
• Provide more context for failed aggregation operators. by @cpwright in #5119

Full Changelog: v0.32.0...v0.33.0

v0.32.1

• 6ab3cd3 - Propagate Blink Attribute Downstream of View/UpdateView/Select/UpdateView (#5125)
• f3ebf39 - Add AggWAvg support for rollup() (#5121)
• c7dc934 - Ensure wildcard imports work against JRE classes (#5117)
• 6f73f76 - Add Py version check for using eval_str flag of the inspect.signature() (#5083)
• d7e3482 - Fix Where performance regression (#5074)
• f12fac4 - Eliminate Double Error Notifications in jsapi and Error Log (#5048)
• 45e14f2 - Re-implement ParallelWhere using JobScheduler semantics. (#5032)

Full Changelog: v0.32.0...v0.32.1

v0.32.0

What's Changed

• feat: Add iframe/widget endpoint for displaying widgets by @mofojed in #4938
• Bump to 0.32.0-SNAPSHOT by @devinrsmith in #4951
• Update image refs to match base image bump to protobuf 3.21.2 by @kosak in #4956
• Correctly allow base64 prefixes for "s/" by @niloc132 in #4958
• Distinguish between np type hints from Py ones by @jmao-denver in #4953
• Bump actions/upload-artifact from 3 to 4 by @dependabot in #4954
• fix: JsPartitionedTable keyColumn and keyColumnTypes ordering by @georgecwan in #4931
• Remove unused/broken tests by @niloc132 in #4961
• Disable Parallel Where for ConditionFilter by @nbauernfeind in #4963
• Move test generation code into README by @devinrsmith in #4965
• Rework server tests to avoid using test sources from other projects by @niloc132 in #4962
• Address dependency and liveness issues in KafkaTools.StreamPartitionedTable by @rcaudy in #4968
• Go Client: Rewrite the AsOfJoin test to use static tables by @kosak in #4971
• Add dictionary (mapping) as a valid argument for new_table() by @jmao-denver in #4966
• Include column name in errors when creating InputColumn by @jmao-denver in #4979
• UpdateGraph: Log Dependency Information On Failure to Proceed by @nbauernfeind in #4980
• Update web version 0.58.0 by @github-actions in #4982
• OperationInitializer usage bug fix and associated cleanups by @rcaudy in #4976
• fix: Add BigInteger and BigDecimal types to MatchFilter.java by @georgecwan in #4912
• Go Client: Update code to match changes in TimeTableRequest, and reenable CI by @kosak in #4990
• HashedRunFinder run-finding improvements by @lbooker42 in #4974
• Go Client: Change TimeTable method to allow a variety of time/period types by @kosak in #4998
• Adjust parameters for floating point tests by @lbooker42 in #4996
• Bump to jetty 11.0.19 by @devinrsmith in #4967
• Add additional JsPlugin documentation by @devinrsmith in #4950
• Bump actions/github-script from 6 to 7 by @dependabot in #4861
• Revise auto-generated doc issues by @mattrunyon in #5008
• PagingChunkSource context protocol documentation, many silly cleanups, hints for channel context integration by @rcaudy in #5000
• Fix pydeephaven-ticking package name and link by @rbasralian in #5013
• Python Client: avoid thread self-join on stop() by @kosak in #5005
• Move OperationInitializer Construction to Dagger Object Graph by @nbauernfeind in #4986
• Fix Server-Side ABORT That Should be CANCELLED by @nbauernfeind in #5018
• Allow ExportObject to be RELEASED When Already Managed by @nbauernfeind in #5014
• Calendar API cleanup by @chipkent in #4201
• docs: Add details about how to debug server by @mofojed in #4927
• Flight: Disable Batching Static Tables by @nbauernfeind in #4985
• Log User-Friendly Error When AutoComplete is not Available by @nbauernfeind in #4316
• Fix broken calendar unit tests over midnight. by @chipkent in #5025
• ReplayTable: Only Fail Table (not the server) on Error by @nbauernfeind in #5020
• Add dependency on jpy>=0.15.0 by @devinrsmith in #5022
• Share PyArrow table data with the server through ByteBuffer by @jmao-denver in #4936
• Calendar API changes so that methods accepting strings return strings by @chipkent in #5029
• fix: Don't memoize retrieval of tables from JsPartitionedTable#getTable by @mofojed in #5009
• Better error logging when calendars do not load properly by @chipkent in #5034
• Support the use of 'from future import annotations' in scripts where Python UDFs are defined. by @jmao-denver in #5033
• Parse legacy calendar XML files. by @chipkent in #5036
• BarrageTable: Use WritableRowRedirectionLockFree in Most Cases by @nbauernfeind in #5038
• Move calendar initialization to server startup by @devinrsmith in #5037
• Add column source reinterpretation for UpdateBy Delta operator. by @lbooker42 in #5043
• Update web version 0.59.0 by @github-actions in #5044
• Fix a few additional failing calendar tests by @devinrsmith in #5046
• Add Groovy container w/ examples and Redpanda by @jjbrosnan in #4673
• BarrageTable: Fix testCoalescingLargeUpdates out-of-memory by @nbauernfeind in #5047

Full Changelog: v0.31.0...v0.32.0