Commit graph

47 commits

Author SHA1 Message Date
Miguel Serrano
89dd3b94b1 Merge pull request #11663 from overleaf/bg-add-migration-force-options
add migration force options

GitOrigin-RevId: 51eb88e995a6e348e00208e9d01c9c1fa6c0c1ea
2023-02-07 09:55:15 +00:00
Miguel Serrano
832a0facba Merge pull request #11658 from overleaf/bg-add-concurrency-to-migration
add concurrency to the history migration script

GitOrigin-RevId: 059a1a8b402627b03cb6dab79b5da22189f32704
2023-02-07 09:55:07 +00:00
Miguel Serrano
f8bc3b3357 Merge pull request #11641 from overleaf/bg-improve-migration-script
improve history migration script

GitOrigin-RevId: bd1b4263ccb3d10f0c9d741e4f11671cf307cd58
2023-02-07 09:54:58 +00:00
Miguel Serrano
df3aff9c66 Merge pull request #11629 from overleaf/msm-exit-migrate-history
[web/scripts] force exit on `migrate_history.js`

GitOrigin-RevId: 298568043c2885b8ad2c6242e7519faccf2f2498
2023-02-02 18:23:08 +00:00
Miguel Serrano
cefdc78c6e Merge pull request #11550 from overleaf/msm-migrate-history-count-fix
[web/scripts] fix error count in `migrate_history.js`

GitOrigin-RevId: d7326c4e25913969f196276c913e70a03398f3ac
2023-01-31 10:35:27 +00:00
Brian Gough
56cb937672 Merge pull request #11529 from overleaf/bg-report-whole-error
log the full result from history migrations

GitOrigin-RevId: 55aaa7bbd88a61234dcf1247ddbf8af543fc4bc1
2023-01-31 09:03:53 +00:00
Miguel Serrano
6787e9c50d Merge pull request #11490 from overleaf/msm-migrate-history-fix
[web/scripts] `history/migrate_history.js` fixes

GitOrigin-RevId: 249e9a3f1dbf89d46335ee208f5922905477845c
2023-01-27 12:04:01 +00:00
Brian Gough
78360b7358 initial history migration script (#11359)
* initial history migration script

* fix case in migration script

GitOrigin-RevId: cd2786605120e998c3b01bfeae436c2fbf7da0fa
2023-01-24 09:03:50 +00:00
Miguel Serrano
1a0e1def66 Merge pull request #11280 from overleaf/bg-issue11277
Move history migration logic to web module

GitOrigin-RevId: 6f1ba33519277b9ba13ecb2a13ae2c43ee06f675
2023-01-24 09:03:43 +00:00
Eric Mc Sween
38df974ce1 Merge pull request #10739 from overleaf/em-history-mongo-backend
Send a history id from web when creating a project

GitOrigin-RevId: dd1417ae734c76990931885df1864a81a9439da0
2022-12-07 09:03:51 +00:00
Eric Mc Sween
5083060fbb Merge pull request #10677 from overleaf/em-history-id-string
Represent history ids as strings instead of integers

GitOrigin-RevId: 18977195b65492836e570c571ec7e8c7e088612b
2022-12-02 09:04:29 +00:00
Eric Mc Sween
8b2f8ce243 Merge pull request #9383 from overleaf/em-file-tree-histories
Track source for all file tree operations

GitOrigin-RevId: ff95ea8e99bfa30203a2a42968519bbaba65e708
2022-08-26 08:03:30 +00:00
Jakob Ackermann
a31f30ed44 Merge pull request #9030 from overleaf/msm-update-allowdowngrade-script
[scripts] Change batching in `unset_allow_downgrade.js`

GitOrigin-RevId: 42542f1b2ca75d184cf2d812f3ebaf291a5992b6
2022-07-29 08:04:28 +00:00
Brian Gough
e32d1dbdd6 Merge pull request #8786 from overleaf/bg-check-age-for-migration
enforce cutoff date for track-changes history migration

GitOrigin-RevId: cd7b76281c66b7e6edc856d70660f2c5b8ae5275
2022-07-12 08:03:11 +00:00
Brian Gough
73f85d6e51 Merge pull request #8780 from overleaf/bg-import-zip-file-for-migration
import track-changes zip file from disk for history migration

GitOrigin-RevId: cb1d7f57e60ea6f627e63753c22f2ffc7e3b79ac
2022-07-12 08:03:05 +00:00
Brian Gough
a822819582 Merge pull request #8762 from overleaf/bg-force-new-history-on-failure
[web] allow forcing new history on migration failure

GitOrigin-RevId: bf84a6edf5a10b6aa3a1653e13a213552cb9272e
2022-07-12 08:03:02 +00:00
Miguel Serrano
88575dc58e Merge pull request #8735 from overleaf/msm-unset-allow-downgrade
[web] script to unset `history.allowDowngrade` in projects

GitOrigin-RevId: c30dfa64bfdd492d659cce308628f9e118449d5c
2022-07-08 08:03:43 +00:00
Brian Gough
be71ea690d Merge pull request #8687 from overleaf/bg-validate-migration-updates
[web] validate updates in history migration

GitOrigin-RevId: 35e11417ff83db81ad1dfd29165577e142e64f74
2022-07-05 08:03:32 +00:00
Brian Gough
da02a4f2be Merge pull request #8644 from overleaf/bg-archive-track-changes
archive track changes zip files in project when history migration fails

GitOrigin-RevId: 67f2381b0a8f2fb1de82100752031c65808af885
2022-07-01 08:03:52 +00:00
Brian Gough
496f283892 Merge pull request #8544 from overleaf/bg-fix-log-message
fix message in downgrade_project script

GitOrigin-RevId: 9619f1122d1d242a1f3cfd7e07c7ddfd908e340e
2022-06-24 08:03:40 +00:00
Brian Gough
b0d48c49f2 Merge pull request #8536 from overleaf/bg-downgrade-history-script
[scripts] downgrade history for a project

GitOrigin-RevId: 620440482e176404529edcbe89d696970bdc5652
2022-06-23 08:02:32 +00:00
Miguel Serrano
1c78e211f6 Merge pull request #8513 from overleaf/msm-fix-conversion-typo
[web] fixed env names in scripts

GitOrigin-RevId: 3989514b23773642d4834ffca12cf97c756ade4c
2022-06-21 08:03:17 +00:00
Miguel Serrano
e7c8329491 Merge pull request #8492 from overleaf/msm-history-migration-convert-large-docs
[web] Updated history upgrade scripts to move large docs to filestore

GitOrigin-RevId: 11ac9fc879ff03756e3ec41bb156e878c4223014
2022-06-21 08:03:13 +00:00
Brian Gough
bc31247d24 Merge pull request #8471 from overleaf/bg-ignore-upgradefailed-when-history-does-not-exist
[scripts] allow history upgrade in failure case

GitOrigin-RevId: 7c789968bd74719e3a0232422094ae3e9231a044
2022-06-20 08:04:17 +00:00
Timothée Alby
34bc2ac9ec Merge pull request #8402 from overleaf/msm-history-conversion-script
[web] Allow running history conversion script on single project

GitOrigin-RevId: 799d0a00e2ebabe6c7bbfd6bdbdb58a6025ce53f
2022-06-15 08:04:30 +00:00
Brian Gough
baa2d08b7f Merge pull request #8340 from overleaf/bg-one-shot-migration-script
[web] allow running history conversion script on single project

GitOrigin-RevId: 038005605a048d97d3fabcfa16b1c2421094e2e5
2022-06-10 08:03:31 +00:00
Miguel Serrano
c5f93bedea Merge pull request #8335 from overleaf/msm-fix-reset-rev-script
Fixed `reset_incorrect_doc_revision.js` script

GitOrigin-RevId: 59448881e372ca7ca6f3b50f76cab5476279a1ab
2022-06-09 08:02:23 +00:00
Miguel Serrano
3238694daa [web] Reset incorrect doc.rev value (#8331)
* [web] Reset incorrect `doc.rev` value

* Applied logging suggestions

GitOrigin-RevId: 6381fea438cf7409845d7a69c5d24e46cbec42c3
2022-06-09 08:02:20 +00:00
Thomas
6f55a99ae1 Merge pull request #6180 from overleaf/tm-history-upgrade-individual-projects
Add script for converting individual projects to FPH and history upgrade helper

GitOrigin-RevId: 4cf075e08045869fe87724fb28949fe91b780e93
2022-05-31 08:04:19 +00:00
Alf Eaton
50df230846 [web] Upgrade Prettier to match version in monorepo root (#6231)
GitOrigin-RevId: 02f97af1b9704782eee77a0b7dfc477ada23e34d
2022-01-11 09:03:23 +00:00
Thomas
abbacd71b7 Merge pull request #6025 from overleaf/tm-history-upgrade-fix-retry-failed
Fix for None without conversion to correctly retry failed upgrades and speed up mongo queries

GitOrigin-RevId: 22d2b936f478ee8395775ed258095f1bf647c88f
2021-12-09 09:02:29 +00:00
Thomas
cb6fc31225 Merge pull request #6017 from overleaf/tm-history-upgrade-v1-with-conversion
Add script for upgrading v1 projects requiring conversion

GitOrigin-RevId: 4f3cec528a0b9ad56db652d831052caa91e62521
2021-12-08 09:03:09 +00:00
Thomas
be17e022a6 Merge pull request #5975 from overleaf/tm-history-upgrade-count-fails
Fix for counting upgrade failures in history counts script

GitOrigin-RevId: a679fc6e588fc236c31f32e3c27883f25b7f6249
2021-12-06 09:02:58 +00:00
Thomas
88dabee6df Add options for controlling hint & retries to history upgrade scripts (#5967)
* Add USE_QUERY_HINT to allow configuring hint usage in history scripts

* Add RETRY_FAILED option to re-attempt previously failed history upgrades

* Add HistoryConversionFailed count to counts script

* Increase default batch size/concurrency on count script

GitOrigin-RevId: a498294719a504b224c04c95363bf098bb80b574
2021-12-02 09:03:10 +00:00
Eric Mc Sween
bcd64d333f Merge pull request #5888 from overleaf/tm-history-upgrade-improve-logging
Prevent unnecessary extra batch, and add a 'continueFrom' helper for BATCH_LAST_ID

GitOrigin-RevId: d6832c40bbed2c27676f4b72d720938707847bfc
2021-11-24 09:03:17 +00:00
Eric Mc Sween
9cf622e013 Merge pull request #5877 from overleaf/tm-history-upgrade-none-with-conversion
Add script for converting and upgrading from SL history to full project history

GitOrigin-RevId: 0e1ad19d3f5cd248ef30e2a0fbb69711cb307b6e
2021-11-24 09:03:13 +00:00
Thomas
5c5f42df1f Merge pull request #5752 from overleaf/tm-history-upgrade-failure-checks
Check for upgradeFailed before classifying/upgrading a project as v1

GitOrigin-RevId: 68776665762e87b640aab4c55a5e56062697912a
2021-11-12 09:02:49 +00:00
Thomas
ec36fe4b04 Merge pull request #5751 from overleaf/tm-history-upgrade-max-failures
Add configurable limit for number of failures (stop when reached)

GitOrigin-RevId: 56f0bf1d2e803851d68918b26f06d3b5834d7cc0
2021-11-12 09:02:45 +00:00
Thomas
97a636b0dd Set force/origin params in project history migration script (None types), handle errors (#5693)
* Use a force resync when initialising full project history, improve error handling, increase default mongo timeout

* Don't remove history ID if error on initialisation

* Rename MAX_PROJECT_UPGRADES to MAX_UPGRADES_TO_ATTEMPT and skip upgrades in the current batch once we reach the limit

* Catch SIGINT and wait for a safe time to exit

* Set overleaf.history.upgradeFailed when errors during history initialisation

GitOrigin-RevId: 2c987926cac9c9727a7b39e9003aa8626d56423f
2021-11-09 09:04:37 +00:00
Thomas
bfda92513a Merge pull request #5694 from overleaf/tm-history-scripts-mongo-timeouts
Update v1 without preserveHistory, increase default mongo timeouts, add count query hint

GitOrigin-RevId: bfe1a0024258d0c75646544b9646928b2afe33c1
2021-11-09 09:04:30 +00:00
Thomas
560e07fa8e Rename and rework script for counting project history states (#5593)
* Rename and rework script for counting project history states

GitOrigin-RevId: a00e4626f09526a0af79f71eb66910259895d0fb
2021-10-29 08:04:08 +00:00
Thomas
d984e3d826 Project history upgrade script for None without SL history (#4814)
GitOrigin-RevId: 604fb8a8193b798be1a342af5f08c004eee5521b
2021-10-08 08:03:00 +00:00
Thomas
3361ccfec1 Merge pull request #5123 from overleaf/tm-history-script-await-fix
Add missing await in history scripts

GitOrigin-RevId: 992e6748bc270845282853db6ec1a7aa496115ea
2021-09-24 08:04:08 +00:00
Thomas
deca6f1f93 Add script to upgrade v1 project histories (if created after full project history enabled) (#4712)
GitOrigin-RevId: b329b83ae4167c3c58b947936d6a460f6f2b4327
2021-08-27 08:03:46 +00:00
Thomas
e25d8b1440 Merge pull request #4381 from overleaf/tm-history-upgrade-batched-update-hints
Extend batchedUpdate to accept find() options, and use a hint in upgrade script query to suggest mongo uses the _id index

GitOrigin-RevId: 7115f84d8be0c78ccb443051e911c931bf4aa0de
2021-08-05 02:08:07 +00:00
Thomas
ebc80fed8a Add script to upgrade v1 project histories (if no SL history) (#4364)
* Add script to upgrade v1 project histories (if no SL history)

GitOrigin-RevId: 997308eec2ed09be4d9d203cb746ca8ac8c88e23
2021-08-04 02:05:35 +00:00
Thomas
b03a4cf7fc Add script to count project history states (#4328)
GitOrigin-RevId: 9f5fce9e162140579841cdad8a2ebb168dde72af
2021-07-28 02:06:24 +00:00