Releases: DataKitchen/dataops-testgen
Releases · DataKitchen/dataops-testgen
4.38.7
Bug Fixes
- test definitions: add dialog error (fdb3ce9)
Docker Image
datakitchen/dataops-testgen:v4.38.7
PyPI Package
4.38.6
Bug Fixes
- pass signal (275e16a)
- typing for filter options (62de7ba)
- score-breakdown: prevent infinite looping and make defaulting logic consistent (81a63af)
- temporarily disable Schema Drift test (a8d6549)
Docker Image
datakitchen/dataops-testgen:v4.38.6
PyPI Package
4.38.3
Features
- profiling: add progress, approx row counts and error handling (f5f0673)
- sampling: Apply sampling to subqueries (da60a0d)
- test-execution: add progress and error handling (1d1f68f)
- notifications: Adding basic email sending functionality (2842a4c)
- test-definitions: add sort dropdown (5be70ce)
- connections: connect to azure mssql using managed identities (b2ce30d)
Bug Fixes
- Updating services images to point to bitnamis legacy repo (809d25a)
- db-data-type: handle null values (e9c196d)
- runs: empty state css (10e0d86)
- address pr feedback (2e0bc64)
- scores: profiling rollup queries retrieval (056024a)
- schedules: migrate test run schedules to use id (bebfae5)
- test-generation: handle pipes and newlines in LOV Match test (94526a0)
- lookup: add templated limit counts to lookup queries (1c1096e)
- grid: initial selection not working (c93d08b)
- test: improve table freshness test to avoid overflow (d173535)
- address review comments (433177b)
- update default max query chars (4c4fe4f)
- ui: profiling dialog error (458d77d)
- test-results: error on refresh score (b1cb525)
- error on download dialog (a38786f)
- profiling-runs: error on cancel and improve display (57c8447)
- test-runs: improve display for canceled runs (6a17e3f)
- quality-dashboard: scorecard display and sorting (808542f)
- test-execution: improve progress tooltip (9b54583)
Miscellaneous
Docker Image
datakitchen/dataops-testgen:v4.38.3
PyPI Package
4.32.5
Features
- bigquery: Adding BigQuery to the connections pages (76ad544)
- bigquery: Support BigQuery for Profiling (b9ef2b4)
- bigquery: Support BigQuery for Test Generation (74a9569)
- add support for redshift spectrum (6fcca5e)
- pagination: paginate grid component (53bfb66)
- project-dashboard: display data point counts (1f58efb)
- schedules: support pausing/resuming job schedules (4b57cd7)
- hygiene-issues: add summary counts component (d060b0e)
- monitor: add data structure log (f07de29)
- data-type: track database data type for columns (a38046d)
Bug Fixes
- connection: save button not enabled correctly when switching flavors (cab8b61)
- sorting selector: selected items not sorted correctly (c60a840)
- sql: quote snowflake identifiers correctly (35ccbef)
- tests: don't quote columns in Timeframe Combo Match (cc50412)
- redshift: profiling error for timestamps with time zone (4d1e261)
- postgres: profiling bugs on money and time data types (32517ab)
- Applying sampling to the secondary profiling query (3c7f5ea)
- pagination: handle invalid page in query (2f86195)
- Updating services images to point to bitnamis legacy repo (56ec66d)
- source-data: fix lookup queries for Valid_US_Zip3 test (2c35f44)
- source-data: set max height for sql query (919eb3e)
- table freshness: arithmetic overflow in mssql (ca67e56)
- test-results: add details text to bottom section (b67008d)
- project-dashboard: improve css responsiveness (fc71112)
- connection-form: validation on file fields, clear db fields (8cd4849)
- test-validation: detect missing columns in Dupe_Rows test (2fe741a)
- logs: suppress noisy logs during setup and upgrade (62252a9)
- mssql: arithmetic overflow error in Incr_Avg_Shift test (a1500cd)
- add QUOTE to test and lookup queries to support non-standard identifiers (5edee1e)
- hygiene-issues: numeric value out of range error (d4076a1)
- test-validation: handle commas in column names (b5af463)
- miscellaneous qa fixes (af22198)
- sampling: trim quotes in estimate query (007a17a)
- profiling-results: make filters consistent with hygiene issues (8fd8cc8)
- grid: remove unpaginated filter and sort (5d0f4d0)
- connection: unnecessary rerender of file input (1f540de)
- hygiene-issues: include potential pii in possible count (7b4d688)
- clear cache on page refresh (d2e2246)
Refactors
- run-pages: move filters and pagination to vanjs (c83787d)
Miscellaneous
- Addressing code review feedback (730c1b6)
Docker Image
datakitchen/dataops-testgen:v4.32.5
PyPI Package
testgen-services-0.1.1
A Helm chart for Kubernetes
4.26.1
Features
- schedules: add cron expression editor component (7859cb5)
- connections: add warehouse field to snowflake form (68b0dc2)
- display sql query in source data dialogs (6b004cb)
- tests: generate a monitor suite for new table groups (97fb07a)
- ui: allow filtering timezone dropdown (e41338a)
Bug Fixes
- analytics: error in username (18a0d63)
- test suites: allow spaces in name (f3d40cb)
- exports: add schema header detail and remove column (7bd44ef)
- apply case insensitive sorting (c05c344)
- application logs: make search case insensitive (f2fbce6)
- connections: set snowflake account in connection url (3712b8b)
- connections: enforce required url and private key (ce5122c)
- incorrect test counts in generate tests warning (94b67ab)
- Fixing LOV_All input (af7dd51)
- append snowflake computing domain when missing (9cb87e8)
- table freshness: filter general type in fingerprint (646f38f)
- prevent STDEV overflow error (a893d2c)
- general types: update schema ddf queries (0ffba6d)
- profiling: increase char limit when calculating pattern (9c78277)
- mssql: update is_date function (f44230c)
- copy tests: bugs when copying multiple and table tests (b3f1c90)
- hygiene issues: sort by likelihood first (4dff068)
Refactors
- validate required fields for connections (1702008)
- connections: stop creating an initial connection (8661083)
Miscellaneous
- Allow re-using the existing users and roles (b30bc62)
Docker Image
datakitchen/dataops-testgen:v4.26.1
PyPI Package
4.22.2
Features
- add partial name filter to table group list (603828c)
- forms: improve field validation (d4d198f)
- radio-group: support vertical layout (ab190bd)
- add history related fields to test definitions (2cdffe6)
- tests: add log severity (614747e)
- tests: customize visualization for stale table test type (bc83dcc)
Bug Fixes
- test definitions: bugs in validate test query (bad261e)
- display a show/hide icon for password fields (3620af0)
- runs: duration display incorrect when > 24 hours (6a54f2e)
- styles: misc css improvements (a5e2a06)
- tests: add missing result_signal column (3b3d3f3)
- tests: add flavor specific stale table test generation (80c644b)
- test definitions: id missing for user-defined tests (b76bc22)
- test types: rename "stale table" to "table freshness" (49ac837)
- test definitions: remove unnecessary validation (f9e7476)
- test results: make binary bars wider (cddaf91)
- quick-start: adjust dates to 30 days ago (1783886)
Refactors
- ui: extend input component to support hidding password suggestions (0923d65)
- auth: implement as plugin class (b5757d4)
- remove dead code (1a55681)
- database service and param replace for process execution (35120c4)
Miscellaneous
- connection: trim leading and trailing whitespaces (7208e8a)
- Consolidate demo into a single quick-start call. (f2dfe40)
Docker Image
datakitchen/dataops-testgen:v4.22.2
PyPI Package
4.20.4
Features
- table groups: verify access to tables (a2e5f39)
- allow dismissing items from sorting selector (378be3b)
- test results: add action filter (1002c09)
- profiling: use native sampling (2cdc51a)
Bug Fixes
- upgrade command (f45cb80)
- sql: handle None when replacing params (dc29dd2)
- analytics: update query fetch (bc01a5e)
- sql: remove unnecessary str conversion for params (66fce8a)
- profiling: copy error when any query fails (3857d14)
- don't log full queries when upgrading system version (5a4b43e)
- profiling: sampling bugs in some flavors (3de8e8d)
- empty states in table groups and test suites pages (819c45c)
- test suites: remove unnecessary fields, disable export option when not configured (a35eb84)
- sql: incorrect parentheses in row_ct_pct test for mssql (0187c84)
- empty states in profiling runs and test runs pages (2a8bf49)
- empty state in profiling runs (f5c06be)
- empty state in project dashboard (cec1822)
- empty state in quality dashboard (cdc4e1d)
- empty state in score issues (21992e2)
- issue report: sample data not loading in score issues test reports (e92c114)
- data catalog: broken table create script (c06fbd7)
- data catalog: bugs in column history dialog (bbc45ba)
- data catalog: don't apple searchOptions when search is empty (960f67d)
- hygiene issues: error on exporting all issues (66d106a)
- test definitions: fix condition for disabling disposition buttons (9cee2ad)
- nav: validate query parameters (fdea797)
- queries: handle None results gracefully (900025a)
- profiling: error when running in background (d720d5a)
- cli: generate-tests command broken (ee8845f)
- redshift: remove unnecessary pre connection query (f8d48fb)
- data catalog: numbers are rounding unnecessarily (6649939)
- analytics: login usage event (877ede5)
Refactors
- database service and param replace for process execution (59a5c68)
- use bind parameters in app database sql for process execution (2902516)
- add sqlalchemy models for entities (9825592)
- use sqlalchemy models and bind params on all ui pages (6446a49)
- remove dead code (b6fb08d)
- Improving how pipeline parameters are obtained (e6c0675)
Miscellaneous
- Add example Aggregate Balance Test to Demo Data and Quickstart (a865c61)
Docker Image
datakitchen/dataops-testgen:v4.20.4
PyPI Package
4.16.3
Features
- Add Run Tests button to Test Definitions page (bc24c5c)
- add test_name filtering to test definitions page (fba3247)
- table groups: enforce verification before saving (4976bf6)
- data-catalog: add table create script dialog (1028580)
- table group: add checkbox for including in project dashboard (0bedec1)
- table group: allow explicit table list to be split by newlines (3c58b85)
Bug Fixes
- miscellaneous bug fixes and style improvements (1768565)
- hygiene issue: update criteria for Unexpected US States (1ebd004)
- issue report: prevent infinite loop (3aee19e)
- analytics: username missing in background processes (8208112)
- wizards: disable checkbox on last step (285691b)
- copy test: typo in query (ebca49d)
- table group: strip whitespace from explicit table list for preview (dfd9c2f)
- hygiene issues: remove icons in action filter before query (0a7354d)
- data catalog: error in table create script (e1ee311)
- connections: decode private key when previewing table group (e91e414)
- connections: url not saving as entered (e0da82e)
Refactors
Docker Image
datakitchen/dataops-testgen:v4.16.3
PyPI Package
4.12.6
Features
- add help menu, support mailto, and upgrade notification (325569b)
- project-dashboard: redesign cards layout (5aabcbd)
- Adding duplicated rows test and hygiene issues; Tuning test selection (4e206cf)
- version: get latest release versions from s3 (e4d3d14)
- telemetry: Capturing failed logins; Persistent instance ID (99c1b83)
- test-definitions: align matching attributes for aggregate tests (f502fdf)
- tests: add aggregate balance percent and range tests (91d7121)
- test suites: warn users before unlocking a test definition (009d3fb)
- tests: Support moving and copying test definition to same suite with different columns TG-899 (d064811)
- data-catalog: add test count and dropdown options for export (fa3c125)
- export: add dropdown options to test definitions and result pages (e68f67d)
- schedules: add schedule dialogs to table groups and test suites pages (bc9a54e)
- allow deleting profiling runs (2aba7f0)
- allow filtering by partial column name (c770e15)
Bug Fixes
- test runs: sample the source data lookup DataFrame (5aff0e0)
- source-data: bug when sampling dataframe (aff987a)
- logo: prevent logo resize (3f48615)
- source-data: preserve sort order when sampling (72f8692)
- snowflake: upgrade python connector to fix certificate error (b6d5741)
- docker: missing arg for support email (87c0692)
- table-groups: handle connections with no flavor code (b44fb46)
- test runs: hide score if no tests were run (cb5cda4)
- upgrade: drop views before altering table (9c846e1)
- Inserting the Test Run record earlier in the process (8a72804)
- Allowing literal underscores in the table group pattern fields (a43194e)
- data-catalog: add commas when displaying numbers (e72b2b4)
- data-catalog: column tags not updated when table fully selected (c98b12e)
- sort: close popover on apply (4beff73)
- misc styling improvements (5fcf9d3)
- tests: flag invalid tests and display Error details in test results (56d2d0d)
- Do not generate Required Entity tests for empty tables (773e771)
- grid: change to current selection not reflected (633c64f)
- issue-report: error status in test history breaks export (add3610)
- Allowing literal underscores in the table group pattern fields (3d1d469)
- profiling: don't apply sample ratio to date_days_present (a089c96)
- table-groups: sampling incorrectly displayed (cfe80a1)
- select: handle none values in run dialogs (8a41d6c)
- connections: stop connection form from re-rendering needlessly (c914376)
- Fixing hygiene issues lookup queries (3d3191b)
- grid: dialogs on grids close abruptly (4d0b330)
- misc styling improvements (aa6007e)
Refactors
- table groups: implement page as vanjs components (58159e4)
- table groups: lock the schema field when profiling or tests exist (d3e37cd)
- flavor-service: update connect args and templated variables (aef8d1a)
- test runs: allow deleting multiple test runs (d878004)
- test definitions: display profiling and generation date (435aa22)
- test results: style and arrangement of elements in result details (ea88bbb)
Miscellaneous
- test runs: limit result history in issue PDF report (d406e7b)
- apply limit to hygiene issue report (2d2dc39)
- set limit to source data lookups in ui dialog (c48bd3a)
- Fixing the test result page for the Dupe_Rows test (84711e7)
- analytics: add usage counts to login event (af3d648)
- Addressing code review feedback (99513b6)
- Addressing code review feedback (9d37db6)
- upgrade Streamlit from 1.44.1 to 1.46.1 (c481d0d)
Docker Image
datakitchen/dataops-testgen:v4.12.6