Update NEWS file for 0.9.1 Beta 1
Merge branch 'dev' of github.com:mdbtools/mdbtools into dev
Version 0.9.1, Beta 1
Windows GitHub Action (#231)
* Migrate the Windows Msys2 build from Appveyor to GitHub Actions
* Fix build with newer versions of Msys2 (fix `vasprintf` conflict)
* Enable SQL tests on the Cygwin build on Appveyor
* Fix an error message about Bison not being available when in fact Flex was not available
* Don't fail fast with Mac and Linux GitHub Actions
* Migrate the Windows Msys2 build from Appveyor to GitHub Actions
* Fix build with newer versions of Msys2 (fix `vasprintf` conflict)
* Enable SQL tests on the Cygwin build on Appveyor
* Fix an error message about Bison not being available when in fact Flex was not available
* Don't fail fast with Mac and Linux GitHub Actions
Use scientific notation only for very small numbers
See #84
See #84
SQLite does not support foreign keys via ALTER TABLE
See #82. A complete solution would add the foreign keys to CREATE TABLE
but the goal here is to stop generating bad SQL.
See #82. A complete solution would add the foreign keys to CREATE TABLE
but the goal here is to stop generating bad SQL.
Merge pull request #93 from ewenmcneill/postgres_namespace_fixes
Postgres: No namespace in INDEX, CONSTRAINT names
Postgres: No namespace in INDEX, CONSTRAINT names
Postgres: No namespace in INDEX, CONSTRAINT names
src/libmdb/backend.c:mdb_print_indexes() and
src/libmdb/backend.c:mdb_get_relationships(): In PostgreSQL the INDEX
names explicitly must not have a namespace name on them; they are always
created in the namespace of the table. See:
http://www.postgresql.org/docs/current/static/sql-createindex.html
which says: "The name of the index to be created. No schema name can be
included here; the index is always created in the same schema as
its parent table."
By observation the same is true for CONSTRAINT names; they are refused
if the namespace is included before them.
Also omit the namespace from the FOREIGN KEY constraint _column_ names
on PostgreSQL (it's not clear that the _column_ names should ever be
namespaced, but behaviour should currently be unchanged for databases
other than PostgreSQL).
src/libmdb/backend.c:mdb_print_indexes() and
src/libmdb/backend.c:mdb_get_relationships(): In PostgreSQL the INDEX
names explicitly must not have a namespace name on them; they are always
created in the namespace of the table. See:
http://www.postgresql.org/docs/current/static/sql-createindex.html
which says: "The name of the index to be created. No schema name can be
included here; the index is always created in the same schema as
its parent table."
By observation the same is true for CONSTRAINT names; they are refused
if the namespace is included before them.
Also omit the namespace from the FOREIGN KEY constraint _column_ names
on PostgreSQL (it's not clear that the _column_ names should ever be
namespaced, but behaviour should currently be unchanged for databases
other than PostgreSQL).
Fix Appveyor builds
Migrate from Travis CI to GitHub Actions (#229)
* Add GitHub Actions workflow
* Consolidate CI test commands into test_script.sh
* Remove Travis build
* Add GitHub Actions workflow
* Consolidate CI test commands into test_script.sh
* Remove Travis build
Merge pull request #228 from evanmiller/no-math
Remove math.h
Remove math.h
Remove math.h
Merge pull request #227 from evanmiller/index-lang
Use the language ID from the DB header for indexing
Use the language ID from the DB header for indexing
Use the language ID from the DB header for indexing
According to the HACKING file, the file's default language ID is stored
in the database header. Use this value instead of a generic English
language locale for indexing JET4 files.
Columns can have their own text sorting rules, including language ID
distinct from the file's language ID, but this is not addressed as we'd
have to break the mdb_index_hash_text function signature, which I'm not
prepared to do just yet.
There appear to be two bytes after the language ID that may indicate
additional sorting flags. These bytes need additional research.
According to the HACKING file, the file's default language ID is stored
in the database header. Use this value instead of a generic English
language locale for indexing JET4 files.
Columns can have their own text sorting rules, including language ID
distinct from the file's language ID, but this is not addressed as we'd
have to break the mdb_index_hash_text function signature, which I'm not
prepared to do just yet.
There appear to be two bytes after the language ID that may indicate
additional sorting flags. These bytes need additional research.
Merge pull request #225 from evanmiller/gcc-initializers
Use GCC style initializers for MdbFormatConstants
Use GCC style initializers for MdbFormatConstants
Use GCC style initializers for MdbFormatConstants
Merge pull request #224 from evanmiller/jet3-encodings
Simplify header-reading logic and support JET3 code pages
Simplify header-reading logic and support JET3 code pages
Add a simple Latin-1 => UTF-8 transcoder w/o iconv
Simplify header-reading logic and support JET3 code pages
Using the notes and RC4 key provided in the HACKING file, decrypt the
database definition page all at once instead of decrypting individual
fields with ad-hoc keys. Use the newly decrypted header to access the
database code page at offset 0x3C, and use this numeric value to
initialize the iconv converter with an appropriate charset name for
popular windows code pages. More encodings can be added later, with
the eventual goal of getting rid of the MDB_JET3_CHARSET environment
variable.
Note that individual columns can have their own code pages but this
issue is not addressed.
An extra field is added to the MdbFile structure - because this
struct is allocated internally, this should not break the public
ABI.
Finally, only set the db_passwd field if it's a JET3 database (see #144)
Using the notes and RC4 key provided in the HACKING file, decrypt the
database definition page all at once instead of decrypting individual
fields with ad-hoc keys. Use the newly decrypted header to access the
database code page at offset 0x3C, and use this numeric value to
initialize the iconv converter with an appropriate charset name for
popular windows code pages. More encodings can be added later, with
the eventual goal of getting rid of the MDB_JET3_CHARSET environment
variable.
Note that individual columns can have their own code pages but this
issue is not addressed.
An extra field is added to the MdbFile structure - because this
struct is allocated internally, this should not break the public
ABI.
Finally, only set the db_passwd field if it's a JET3 database (see #144)
Use wcstombs when iconv is not present (#223)
Replace the jerry-built UTF-16 => Latin-1 code path with a cross-platform wcstombs solution that emits UTF-8.
This adds an element to the end of the MdbHandle struct, but should not break any existing code.
A run-time option could be added later to emit other encodings, but people who care about such things can just use the iconv code path.
Replace the jerry-built UTF-16 => Latin-1 code path with a cross-platform wcstombs solution that emits UTF-8.
This adds an element to the end of the MdbHandle struct, but should not break any existing code.
A run-time option could be added later to emit other encodings, but people who care about such things can just use the iconv code path.
Fix unused but set variable warning (#221)
Refactor mdb_unicode2ascii to eliminate warnings
Refactor mdb_unicode2ascii to eliminate warnings
Clarify mdb_unicode2ascii API and fix buffer overrun (#220)
There was some confusion as to whether the destination buffer length
should include space for the null terminator. Some callers of the
function assumed that a terminator would be added beyond the end
of the stated buffer size, while others did not. Make everything
consistent and also fix an overrun when there was insufficient
space for the output in the non-iconv implementation.
As stated in a code comment, a better solution would follow the lead
of libxls and use wcstombs and friends when iconv is not available.
But this gets into the weeds with conversion functions named differently
across platforms. The goal here is to fix the buffer overrun.
See oss-fuzz/28773
There was some confusion as to whether the destination buffer length
should include space for the null terminator. Some callers of the
function assumed that a terminator would be added beyond the end
of the stated buffer size, while others did not. Make everything
consistent and also fix an overrun when there was insufficient
space for the output in the non-iconv implementation.
As stated in a code comment, a better solution would follow the lead
of libxls and use wcstombs and friends when iconv is not available.
But this gets into the weeds with conversion functions named differently
across platforms. The goal here is to fix the buffer overrun.
See oss-fuzz/28773
Merge pull request #219 from evanmiller/oss-fuzz-28790
Fix integer overflow
Fix integer overflow
Fix buffer overflow (#218)
See oss-fuzz/28787
See oss-fuzz/28787
Merge pull request #217 from evanmiller/oss-fuzz-28780
Fix stack overflow
Fix stack overflow
Merge pull request #216 from evanmiller/oss-fuzz-28779
Null-terminate binary strings
Null-terminate binary strings
Fix integer overflow
See oss-fuzz/28790
See oss-fuzz/28790
Fix stack overflow
See oss-fuzz/28780
See oss-fuzz/28780
Null-terminate binary strings
See oss-fuzz/28779
See oss-fuzz/28779
Version 0.9.0, final
Update configure.ac
* AM_SILENT_RULES has been around for 9 years so just assume it
* dist-zip adds a ZIP archive step to "make dist"
* AM_SILENT_RULES has been around for 9 years so just assume it
* dist-zip adds a ZIP archive step to "make dist"
Fix Appveyor link
Update CI badges to dev branch
Fix libmdbsql build on Windows
Merge pull request #213 from mdbtools/nirgal-patch-2
Drop obsolete files from .gitignore
Drop obsolete files from .gitignore
Drop obsolete files from .gitignore
Restore GLib detection. Fixes #212
Merge branch 'dev' of github.com:mdbtools/mdbtools into dev
Merge pull request #211 from mdbtools/nirgal-patch-1
Remove obsolete comment
Remove obsolete comment
Remove obsolete comment
Version 0.9.0, Beta 8
Merge pull request #208 from evanmiller/remove-old-docs
Remove old documentation
Remove old documentation
Remove -Wno-portability from CI scripts
Merge branch 'master' into remove-old-docs
Merge pull request #206 from evanmiller/test-pkg-config-2
Verify pkg-config on Travis
Verify pkg-config on Travis
Merge branch 'master' into remove-old-docs
Remove out of date documentation
The HTML docs have not been updated in 10+ years. The README and man
pages should suffice for now.
The HTML docs have not been updated in 10+ years. The README and man
pages should suffice for now.
Merge pull request #204 from evanmiller/remove-specfile
Remove mdbtools spec file
Remove mdbtools spec file
Have libmdb.pc reflect --disable-glib
Also try to work around Travis issues with sudo, libtool, and clang
Also try to work around Travis issues with sudo, libtool, and clang
Verify pkg-config on Travis
Now featuring sudo
Now featuring sudo
Remove mdbtools spec file
This is used to build RPMs, but it is out of date and not under test
coverage. If someone would like to restore it, please add some kind of
test coverage so that it does not fall out of date in the future.
See #201
This is used to build RPMs, but it is out of date and not under test
coverage. If someone would like to restore it, please add some kind of
test coverage so that it does not fall out of date in the future.
See #201
Merge pull request #200 from evanmiller/remove-changelog
Remove ChangeLog/CHANGELOG.md
Remove ChangeLog/CHANGELOG.md
Version 0.9.0, Beta 7
Merge pull request #199 from evanmiller/remove-deprecated
Remove deprecated functions
Remove deprecated functions
Merge branch 'master' into remove-deprecated
Remove ChangeLog/CHANGELOG.md
The cyberemissary notes were technically NEWS (about an unofficial
release) and the earlier VCS notes are useless.
The cyberemissary notes were technically NEWS (about an unofficial
release) and the earlier VCS notes are useless.
mdb-count is new since 0.7.1 [CI SKIP]
Remove GMDB section from TODO
This information has been copied to gmdb2's TODO file
This information has been copied to gmdb2's TODO file
Remove mem.c from Makefile
Remove long-deprecated functions
mdb_init() and mdb_exit() have done nothing for a while.
mdb_get_coltype_string() and mdb_coltype_takes_length() were previously
removed, but remained in the header file by accident.
mdb_init() and mdb_exit() have done nothing for a while.
mdb_get_coltype_string() and mdb_coltype_takes_length() were previously
removed, but remained in the header file by accident.
Add CLI deprecation notices to README
Merge pull request #198 from nirgal/deprecation
Deprecate mdb-array mdb-header mdb-parsecsv
Deprecate mdb-array mdb-header mdb-parsecsv
Remove unused packaging script
package.sh is a vestige of the cyberemissary fork.
package.sh is a vestige of the cyberemissary fork.
Deprecation warning in the manuals
Deprecate mdb-array mdb-header mdb-parsecsv
Move 0.9 release information from README to NEWS
Merge branch 'dev' of github.com:mdbtools/mdbtools into dev
Modernize Debian install command
Version 0.9.0, Beta 6
Merge pull request #194 from evanmiller/bounds-check-mdb-sql-bind-column
[Updated] Bounds check mdb_sql_bind_column()
[Updated] Bounds check mdb_sql_bind_column()
Merge branch 'dev' of github.com:mdbtools/mdbtools into dev
Merge pull request #196 from mdbtools/nirgal-AUTHORS
Refreshed AUTHORS
Refreshed AUTHORS
Refreshed AUTHORS
Dropped the description of who did what, as this is too complex to maintain.
Sorted by year, for copyrights purposes.
Dropped the description of who did what, as this is too complex to maintain.
Sorted by year, for copyrights purposes.
Merge branch 'dev' of github.com:mdbtools/mdbtools into dev
Merge pull request #195 from evanmiller/thread-safety
Use re-entrant functions and thread-local storage in a couple of places
Use re-entrant functions and thread-local storage in a couple of places
Use thread-local storage to cache run-time options
Use re-entrant functions in a couple of places
Replace strtok and gmtime with their re-entrant versions. More to come.
Replace strtok and gmtime with their re-entrant versions. More to come.
Fix indentation warning on GCC
Version 0.9.0, Beta 5
Fix syntax error
Merge pull request #185 from mjwoodcock/odbc-string-truncation
Don't include length of '\0' in SQLGetData pcbValue
Don't include length of '\0' in SQLGetData pcbValue
Bounds check mdb_sql_bind_column()
Return -1 if the bounds check fails, otherwise the result of
mdb_bind_column_by_name.
Update other places in the code to check the return value.
Return -1 if the bounds check fails, otherwise the result of
mdb_bind_column_by_name.
Update other places in the code to check the return value.
Merge pull request #193 from evanmiller/largefile
Large file support on 32-bit systems
Large file support on 32-bit systems
Large file support on 32-bit systems
* Add AC_SYS_LARGEFILE to configure.ac
* Replace fseek with fseeko
* Add AC_SYS_LARGEFILE to configure.ac
* Replace fseek with fseeko
Simplify configure.ac with AC_CHECK_FUNCS
Version 0.9.0, Beta 4
Merge branch 'dev' of github.com:mdbtools/mdbtools into dev
Merge pull request #192 from evanmiller/merge-166
Original author: @rogerswb
* Dynamic allocation of MdbSQL->bound_values
Was previously hardcoded to 256 columns max.
Original author: @rogerswb
* Dynamic allocation of MdbSQL->bound_values
Was previously hardcoded to 256 columns max.
Merge branch 'dev' of github.com:mdbtools/mdbtools into dev
Merge pull request #186 from mjwoodcock/bounds-check-mdb-bind-column
Bounds check mdb_bind_column()
Bounds check mdb_bind_column()
Send error message to stderr
Merge branch 'dev' of github.com:mdbtools/mdbtools into merge-166
Handle errors from mdb_bind_column()
Return column number from mdb_bind_column()
To match the return from mdb_bind_column_by_name().
To match the return from mdb_bind_column_by_name().
Merge branch 'dev' of https://github.com/mdbtools/mdbtools into bounds-check-mdb-bind-column
Modernize bash-completion
Use _init_completion
Support long options with or without =
Auto generate options from the --help using _parse_help
Use _init_completion
Support long options with or without =
Auto generate options from the --help using _parse_help
Added back -q support
Quote shell special characters ...
... and add support for mdb-count mdb-json and mdb-queries
... and add support for mdb-count mdb-json and mdb-queries
Merge pull request #189 from nirgal/insert
mdb-export: Rename --backend into --insert
mdb-export: Rename --backend into --insert
mdb-export: Rename --backend into --insert