Bug 1826062 - Automatic fixes for upgrading Prettier to 2.8.8. r=mossop,perftest-reviewers,webcompat-reviewers,geckoview-reviewers,denschub,devtools-reviewers,sparky,calu

Differential Revision: https://phabricator.services.mozilla.com/D177027

Bug 1826062 - Automatic fixes for Prettier 2.0.5 upgrade. r=mossop,perftest-reviewers,webcompat-reviewers,geckoview-reviewers,denschub,devtools-reviewers,sparky,owlish

Differential Revision: https://phabricator.services.mozilla.com/D177025

Differential Revision: https://phabricator.services.mozilla.com/D178417

Differential Revision: https://phabricator.services.mozilla.com/D178230

Differential Revision: https://phabricator.services.mozilla.com/D178200

Set a default journal_size_limit, so journals are always truncated to a sensible
max size. Change existing consumers to just use the default, but Places that is
using a larger 4MiB limit.
Change auxiliary files (-shm, -journal, -wal, ...) persistance on disk, to
avoid the cost of creating and removing them. Since there is a journal_size_limit
they will be truncated instead of deleted.

Differential Revision: https://phabricator.services.mozilla.com/D172185

As previously discussed, we're not using this telemetry at the moment, we used
it in the past to study main thread IO.
Simplifying the VFS allows us to more easily experiment with other settings
in the future.

Differential Revision: https://phabricator.services.mozilla.com/D172016

Differential Revision: https://phabricator.services.mozilla.com/D172015

Bug 1827351 - Fix non-unified-build bustage in storage/test/gtest/test_deadlock_detector.cpp; r=sergesanspaille

Differential Revision: https://phabricator.services.mozilla.com/D175098

Bug 1822889 - Fix problems in ObfuscatingVFS with decoding frames read from the WAL file during recovery; r=dom-storage-reviewers,asuth,hsingh

Differential Revision: https://phabricator.services.mozilla.com/D172824

Depends on D174459

Differential Revision: https://phabricator.services.mozilla.com/D174460

Bug 1825324 - Make widget/* buildable outside of a unified build environment r=andi,geckoview-reviewers,m_kato

Differential Revision: https://phabricator.services.mozilla.com/D173969

Differential Revision: https://phabricator.services.mozilla.com/D173637

Backed out 12 changesets (bug 1825325, bug 1825336, bug 1825333, bug 1825332, bug 1825324, bug 1824557, bug 1825328, bug 1825335, bug 1825330, bug 1825329, bug 1825327, bug 1825331) for causing build bustages in nsClipboard.cpp CLOSED TREE

Backed out changeset 9de3ed24d3a0 (bug 1825336)
Backed out changeset aef787728f19 (bug 1825335)
Backed out changeset a04c341244c1 (bug 1825333)
Backed out changeset e3ad15f762ba (bug 1825332)
Backed out changeset eed23da92a27 (bug 1825331)
Backed out changeset 8213bb54376e (bug 1825330)
Backed out changeset 747ec5ac4994 (bug 1825329)
Backed out changeset e91ff431f92d (bug 1825328)
Backed out changeset 59c18d13768b (bug 1825327)
Backed out changeset 538096d99e49 (bug 1825325)
Backed out changeset c76eb9d9b095 (bug 1825324)
Backed out changeset 8b81410eb686 (bug 1824557)

Bug 1825324 - Make widget/* buildable outside of a unified build environment r=andi,geckoview-reviewers,m_kato

Depends on D173637

Differential Revision: https://phabricator.services.mozilla.com/D173969

Differential Revision: https://phabricator.services.mozilla.com/D173637

Differential Revision: https://phabricator.services.mozilla.com/D173409

Backed out changeset 14879c9b6b3c (bug 1813986)
Backed out changeset d90fa56c73e5 (bug 1813986)

Bug 1813986 - Add an asyncVacuum() method to storage async connections, and let VacuumManager use it. r=asuth

Add asyncVacuum to mozIStorageAsyncConnection, that dispatches a runnable to
the helper thread, where it will execute a full or incremental vacuum, depending
on the connection auto_vacuum value.
It also supports vacuuming attached schemas.
asyncVacuum() supports changing both the page_size and auto_vacuum.
Change mozIStorageVacuumParticipant to return a mozIStorageAsyncConnection and
allow specifying whether incremental vacuum should be enabled.
Change vacuumManager notification from heavy-io-task to vacuum-begin and vacuum-end
since the original proposal of notifying heavy IO didn't take off.
Cleanup test_vacuum to be able to use instances of the test VacuumParticipant,
that means we can remove the no more necessary registerESM hack.
Fix Places History as the only cpp consumer.

Differential Revision: https://phabricator.services.mozilla.com/D168298

Bug 1813986 - Add an asyncVacuum() method to storage async connections, and let VacuumManager use it. r=asuth

Add asyncVacuum to mozIStorageAsyncConnection, that dispatches a runnable to
the helper thread, where it will execute a full or incremental vacuum, depending
on the connection auto_vacuum value.
It also supports vacuuming attached schemas.
asyncVacuum() supports changing both the page_size and auto_vacuum.
Change mozIStorageVacuumParticipant to return a mozIStorageAsyncConnection and
allow specifying whether incremental vacuum should be enabled.
Change vacuumManager notification from heavy-io-task to vacuum-begin and vacuum-end
since the original proposal of notifying heavy IO didn't take off.
Cleanup test_vacuum to be able to use instances of the test VacuumParticipant,
that means we can remove the no more necessary registerESM hack.
Fix Places History as the only cpp consumer.

Differential Revision: https://phabricator.services.mozilla.com/D168298

Bug 1781116 - QuotaManager needs to deal with SQLite path canonicalization/symlink piercing; r=asuth,dom-storage-reviewers

Depends on D171440

Differential Revision: https://phabricator.services.mozilla.com/D171869

Bug 1819535 - Extract quota related stuff from TelemetryVFS into standalone QuotaVFS; r=dom-storage-reviewers,mak,asuth

Differential Revision: https://phabricator.services.mozilla.com/D171440

Backed out changeset 80713e5124f3 (bug 1819535) for causing build bustages on mozStorageService.cpp. CLOSED TREE

Bug 1819535 - Extract quota related stuff from TelemetryVFS into standalone QuotaVFS; r=dom-storage-reviewers,mak,asuth

Differential Revision: https://phabricator.services.mozilla.com/D171440

Differential Revision: https://phabricator.services.mozilla.com/D167051

Differential Revision: https://phabricator.services.mozilla.com/D164707

Bug 1806359 - Convert telemetry imports to direct ES imports. r=necko-reviewers,application-update-reviewers,pip-reviewers,credential-management-reviewers,janerik,mconley,sgalich,bytesized,kershaw

Differential Revision: https://phabricator.services.mozilla.com/D165002

Differential Revision: https://phabricator.services.mozilla.com/D163157

Bug 1657551 - Part 6: Have a static ConcurrentStatementsHolder::Create function that handles errors returned from mozIStorageConnection::AsyncClone and transform some MOZ_ASSERT into NS_ENSURE_SUCCESS. r=mak

Depends on D163050

Differential Revision: https://phabricator.services.mozilla.com/D163083

Differential Revision: https://phabricator.services.mozilla.com/D162972

When ignoreLockingMode option is used, we default to the unix-none or win32-none
VFS, and enforce the connection to be read-only, because it's trivial to
corrupt data using a no-lock VFS.
Unfortunately read-only mode doesn't allow to open a WAL database if the journal
files are missing, unless the device is marked as "immutable".
There is no SQLITE_OPEN_* flag for immutable, and adding one could easily be
misinterpreted since it only makes sense for read-only.

This implement a readonly-immutable-nolock VFS shim on top of unix-none or
win32-none that overrides device characteristics with immutable. When
ignoreLockingMode option is specified, we use this VFS. It can only be used on
read-only connections, as enforced both by Storage service and a MOZ_ASSERT.

Differential Revision: https://phabricator.services.mozilla.com/D162492

Bug 1799314 - Convert consumers of testing modules to import ES modules direct (miscellaneous). r=mossop

Differential Revision: https://phabricator.services.mozilla.com/D161917

Bug 1784966: Encrypt IDB files and data in PBM, r=dom-storage-reviewers,jari,webdriver-reviewers,whimboo

Differential Revision: https://phabricator.services.mozilla.com/D158597

Differential Revision: https://phabricator.services.mozilla.com/D160032

Backed out 12 changesets (bug 1795322) for causing multiple failures e.g. test_deletion_request_ping.py. CLOSED TREE

Backed out changeset aba25cbcda51 (bug 1795322)
Backed out changeset a4a35005ada9 (bug 1795322)
Backed out changeset 8e8d790eb0f4 (bug 1795322)
Backed out changeset db8903454bd3 (bug 1795322)
Backed out changeset 60cc71c61cad (bug 1795322)
Backed out changeset bc6a674994ad (bug 1795322)
Backed out changeset 6ac8a611f8c7 (bug 1795322)
Backed out changeset 9fb873ecfb31 (bug 1795322)
Backed out changeset c8a7a40c2a2f (bug 1795322)
Backed out changeset f2c118b6c6ce (bug 1795322)
Backed out changeset 38df43b4a70f (bug 1795322)
Backed out changeset 89aea8373411 (bug 1795322)

Differential Revision: https://phabricator.services.mozilla.com/D160032

Backed out changeset a266f691a68c (bug 1784966) for causing IDB Encryption related failures CLOSED TREE

Bug 1784966: Encrypt IDB files and data in PBM, r=dom-storage-reviewers,jari,webdriver-reviewers,whimboo

Differential Revision: https://phabricator.services.mozilla.com/D158597

Differential Revision: https://phabricator.services.mozilla.com/D159474

Bug 1792341 - Migrate more toolkit/modules consumers to use direct ES module import. r=Gijs,webdriver-reviewers,perftest-reviewers,necko-reviewers,geckoview-reviewers,preferences-reviewers,application-update-reviewers,pip-reviewers,credential-management-reviewers,sgalich,owlish,bytesized,AlexandruIonescu,whimboo,mconley,mixedpuppy

Mainly automated changes. Some manual ESLint fixes and whitespace cleanup.

Differential Revision: https://phabricator.services.mozilla.com/D158452