Commit graph

14 commits

Author SHA1 Message Date
Thomas
88dabee6df Add options for controlling hint & retries to history upgrade scripts (#5967)
* Add USE_QUERY_HINT to allow configuring hint usage in history scripts

* Add RETRY_FAILED option to re-attempt previously failed history upgrades

* Add HistoryConversionFailed count to counts script

* Increase default batch size/concurrency on count script

GitOrigin-RevId: a498294719a504b224c04c95363bf098bb80b574
2021-12-02 09:03:10 +00:00
Eric Mc Sween
bcd64d333f Merge pull request #5888 from overleaf/tm-history-upgrade-improve-logging
Prevent unnecessary extra batch, and add a 'continueFrom' helper for BATCH_LAST_ID

GitOrigin-RevId: d6832c40bbed2c27676f4b72d720938707847bfc
2021-11-24 09:03:17 +00:00
Eric Mc Sween
9cf622e013 Merge pull request #5877 from overleaf/tm-history-upgrade-none-with-conversion
Add script for converting and upgrading from SL history to full project history

GitOrigin-RevId: 0e1ad19d3f5cd248ef30e2a0fbb69711cb307b6e
2021-11-24 09:03:13 +00:00
Thomas
5c5f42df1f Merge pull request #5752 from overleaf/tm-history-upgrade-failure-checks
Check for upgradeFailed before classifying/upgrading a project as v1

GitOrigin-RevId: 68776665762e87b640aab4c55a5e56062697912a
2021-11-12 09:02:49 +00:00
Thomas
ec36fe4b04 Merge pull request #5751 from overleaf/tm-history-upgrade-max-failures
Add configurable limit for number of failures (stop when reached)

GitOrigin-RevId: 56f0bf1d2e803851d68918b26f06d3b5834d7cc0
2021-11-12 09:02:45 +00:00
Thomas
97a636b0dd Set force/origin params in project history migration script (None types), handle errors (#5693)
* Use a force resync when initialising full project history, improve error handling, increase default mongo timeout

* Don't remove history ID if error on initialisation

* Rename MAX_PROJECT_UPGRADES to MAX_UPGRADES_TO_ATTEMPT and skip upgrades in the current batch once we reach the limit

* Catch SIGINT and wait for a safe time to exit

* Set overleaf.history.upgradeFailed when errors during history initialisation

GitOrigin-RevId: 2c987926cac9c9727a7b39e9003aa8626d56423f
2021-11-09 09:04:37 +00:00
Thomas
bfda92513a Merge pull request #5694 from overleaf/tm-history-scripts-mongo-timeouts
Update v1 without preserveHistory, increase default mongo timeouts, add count query hint

GitOrigin-RevId: bfe1a0024258d0c75646544b9646928b2afe33c1
2021-11-09 09:04:30 +00:00
Thomas
560e07fa8e Rename and rework script for counting project history states (#5593)
* Rename and rework script for counting project history states

GitOrigin-RevId: a00e4626f09526a0af79f71eb66910259895d0fb
2021-10-29 08:04:08 +00:00
Thomas
d984e3d826 Project history upgrade script for None without SL history (#4814)
GitOrigin-RevId: 604fb8a8193b798be1a342af5f08c004eee5521b
2021-10-08 08:03:00 +00:00
Thomas
3361ccfec1 Merge pull request #5123 from overleaf/tm-history-script-await-fix
Add missing await in history scripts

GitOrigin-RevId: 992e6748bc270845282853db6ec1a7aa496115ea
2021-09-24 08:04:08 +00:00
Thomas
deca6f1f93 Add script to upgrade v1 project histories (if created after full project history enabled) (#4712)
GitOrigin-RevId: b329b83ae4167c3c58b947936d6a460f6f2b4327
2021-08-27 08:03:46 +00:00
Thomas
e25d8b1440 Merge pull request #4381 from overleaf/tm-history-upgrade-batched-update-hints
Extend batchedUpdate to accept find() options, and use a hint in upgrade script query to suggest mongo uses the _id index

GitOrigin-RevId: 7115f84d8be0c78ccb443051e911c931bf4aa0de
2021-08-05 02:08:07 +00:00
Thomas
ebc80fed8a Add script to upgrade v1 project histories (if no SL history) (#4364)
* Add script to upgrade v1 project histories (if no SL history)

GitOrigin-RevId: 997308eec2ed09be4d9d203cb746ca8ac8c88e23
2021-08-04 02:05:35 +00:00
Thomas
b03a4cf7fc Add script to count project history states (#4328)
GitOrigin-RevId: 9f5fce9e162140579841cdad8a2ebb168dde72af
2021-07-28 02:06:24 +00:00