Commit graph

185 commits

Author SHA1 Message Date
Brian Gough
e7f040ecf7 Merge pull request #6116 from overleaf/bg-remove-large-broken-docs
[web] allow large broken docs to be deleted

GitOrigin-RevId: 0322f55fcc5448ec1d6e6ee96056b80980bd3406
2021-12-14 09:03:12 +00:00
Thomas
ee08ace46b Merge pull request #6033 from overleaf/bg-add-recover-doc-script
[web] add script to recover dangling docs from redis

GitOrigin-RevId: 2fca3d6b27cb35c6ee6cb1f32588ab7390a63d3f
2021-12-09 09:02:32 +00:00
Thomas
abbacd71b7 Merge pull request #6025 from overleaf/tm-history-upgrade-fix-retry-failed
Fix for None without conversion to correctly retry failed upgrades and speed up mongo queries

GitOrigin-RevId: 22d2b936f478ee8395775ed258095f1bf647c88f
2021-12-09 09:02:29 +00:00
Thomas
cb6fc31225 Merge pull request #6017 from overleaf/tm-history-upgrade-v1-with-conversion
Add script for upgrading v1 projects requiring conversion

GitOrigin-RevId: 4f3cec528a0b9ad56db652d831052caa91e62521
2021-12-08 09:03:09 +00:00
Eric Mc Sween
b22df1dcba Merge pull request #5984 from overleaf/em-unnecessarily-async-functions
Clean up unnecessarily async functions

GitOrigin-RevId: 59f0f0a76b4436f3b99a09b747670d443bac4582
2021-12-07 09:03:33 +00:00
Thomas
be17e022a6 Merge pull request #5975 from overleaf/tm-history-upgrade-count-fails
Fix for counting upgrade failures in history counts script

GitOrigin-RevId: a679fc6e588fc236c31f32e3c27883f25b7f6249
2021-12-06 09:02:58 +00:00
Eric Mc Sween
993a6d0eb9 Merge pull request #5968 from overleaf/em-oversized-docs
Get path from Mongo when fixing oversized docs

GitOrigin-RevId: 07d5425d37faf935c162f57f63f6f1cf4c62d592
2021-12-02 09:03:20 +00:00
Thomas
88dabee6df Add options for controlling hint & retries to history upgrade scripts (#5967)
* Add USE_QUERY_HINT to allow configuring hint usage in history scripts

* Add RETRY_FAILED option to re-attempt previously failed history upgrades

* Add HistoryConversionFailed count to counts script

* Increase default batch size/concurrency on count script

GitOrigin-RevId: a498294719a504b224c04c95363bf098bb80b574
2021-12-02 09:03:10 +00:00
Eric Mc Sween
b9c8627d6a Merge pull request #5957 from overleaf/em-fix-oversized-docs
Add script for fixing oversized docs

GitOrigin-RevId: 513ce326884e00530182d3272a9be1134e1fb1f5
2021-12-01 09:03:16 +00:00
Thomas
40b087fee8 Merge pull request #5952 from overleaf/tm-batched-update-ranges
Add BATCH_RANGE_END(/BATCH_RANGE_START) env vars for batchedUpdate scripts

GitOrigin-RevId: e74f30368194584a6fb398963e0c04f850a8b31d
2021-12-01 09:03:09 +00:00
Eric Mc Sween
76e5d90084 Merge pull request #5915 from overleaf/em-delete-dangling-refs
Add a script for deleting dangling doc and file refs

GitOrigin-RevId: 9de5576e96a6585e72a642324b94744fc605d739
2021-11-26 09:03:33 +00:00
Eric Mc Sween
bcd64d333f Merge pull request #5888 from overleaf/tm-history-upgrade-improve-logging
Prevent unnecessary extra batch, and add a 'continueFrom' helper for BATCH_LAST_ID

GitOrigin-RevId: d6832c40bbed2c27676f4b72d720938707847bfc
2021-11-24 09:03:17 +00:00
Eric Mc Sween
9cf622e013 Merge pull request #5877 from overleaf/tm-history-upgrade-none-with-conversion
Add script for converting and upgrading from SL history to full project history

GitOrigin-RevId: 0e1ad19d3f5cd248ef30e2a0fbb69711cb307b6e
2021-11-24 09:03:13 +00:00
Jakob Ackermann
2261e761f4 Merge pull request #5705 from overleaf/jpa-node-14
[misc] upgrade node version from 12 to 14

GitOrigin-RevId: 15c465c7bb5e42b0c71e2dedb09cf4fe9f1d8ec6
2021-11-19 09:02:56 +00:00
Thomas
302a6fddc8 Merge pull request #5756 from overleaf/tm-history-batched-update-descending
Add BATCH_DESCENDING to reverse processing order of batchedUpdate

GitOrigin-RevId: fb6aff20713dfd8fe6c6a78b64505d96ce4bfb14
2021-11-12 09:02:53 +00:00
Thomas
5c5f42df1f Merge pull request #5752 from overleaf/tm-history-upgrade-failure-checks
Check for upgradeFailed before classifying/upgrading a project as v1

GitOrigin-RevId: 68776665762e87b640aab4c55a5e56062697912a
2021-11-12 09:02:49 +00:00
Thomas
ec36fe4b04 Merge pull request #5751 from overleaf/tm-history-upgrade-max-failures
Add configurable limit for number of failures (stop when reached)

GitOrigin-RevId: 56f0bf1d2e803851d68918b26f06d3b5834d7cc0
2021-11-12 09:02:45 +00:00
Eric Mc Sween
5fc6d7dcb3 Merge pull request #5740 from overleaf/em-gcp-logging-web
Improve GCP logging for web

GitOrigin-RevId: b304c87a3fe46c29189f665eb3daf22c23d6eb8f
2021-11-11 09:03:09 +00:00
Jakob Ackermann
6122520bf5 Merge pull request #5727 from overleaf/jpa-deprecation-warnings
[misc] fix deprecation warnings

GitOrigin-RevId: aa103252e5918143bb1dacb19e87e47bb1784e83
2021-11-09 09:04:44 +00:00
Thomas
97a636b0dd Set force/origin params in project history migration script (None types), handle errors (#5693)
* Use a force resync when initialising full project history, improve error handling, increase default mongo timeout

* Don't remove history ID if error on initialisation

* Rename MAX_PROJECT_UPGRADES to MAX_UPGRADES_TO_ATTEMPT and skip upgrades in the current batch once we reach the limit

* Catch SIGINT and wait for a safe time to exit

* Set overleaf.history.upgradeFailed when errors during history initialisation

GitOrigin-RevId: 2c987926cac9c9727a7b39e9003aa8626d56423f
2021-11-09 09:04:37 +00:00
Thomas
bfda92513a Merge pull request #5694 from overleaf/tm-history-scripts-mongo-timeouts
Update v1 without preserveHistory, increase default mongo timeouts, add count query hint

GitOrigin-RevId: bfe1a0024258d0c75646544b9646928b2afe33c1
2021-11-09 09:04:30 +00:00
Jakob Ackermann
9f45f786cf Merge pull request #5627 from overleaf/jpa-use-mongo-secondary-for-script
[web] scripts: check_institution_users: run mongo queries on secondaries

GitOrigin-RevId: 490592cff926f91f1e24ea907016ddbc03a45f60
2021-11-03 09:03:21 +00:00
Eric Mc Sween
e5676a9643 Merge pull request #5648 from overleaf/em-revert-gcp-logging-web
Revert "Improve GCP logging for web"

GitOrigin-RevId: 92d446baf62108da1df92146eec12a2fe69d30ee
2021-11-02 09:03:29 +00:00
Eric Mc Sween
641b10cceb Merge pull request #5632 from overleaf/em-gcp-logging-web
Improve GCP logging for web

GitOrigin-RevId: 1198fab2e821a55563058171cfa435605216e337
2021-11-02 09:03:22 +00:00
Thomas
560e07fa8e Rename and rework script for counting project history states (#5593)
* Rename and rework script for counting project history states

GitOrigin-RevId: a00e4626f09526a0af79f71eb66910259895d0fb
2021-10-29 08:04:08 +00:00
Brian Gough
3c780c65e8 Merge pull request #5417 from overleaf/hb-restore-doc-from-admin
Restore soft deleted docs from admin

GitOrigin-RevId: 5c94539ae950c401225d2cfe7c0bc978ed258e22
2021-10-26 08:03:31 +00:00
Brian Gough
51b42381bd Merge pull request #5551 from overleaf/bg-node-upgrade-user-facing
upgrade node to v12.22.7 (user facing)

GitOrigin-RevId: ddc6a29beac27fe1ae5d88830fb901667d91ec89
2021-10-25 08:03:02 +00:00
Timothée Alby
735f79ab6a Merge pull request #5364 from overleaf/ta-split-test-assignment-date-backfill
Fix SplitTests assignedAt Type

GitOrigin-RevId: 1711f8672fb8e1525780f869b847117a66ca86ed
2021-10-22 08:04:49 +00:00
Jakob Ackermann
7996f90c7b Merge pull request #5306 from overleaf/jpa-clear-institution-notifications
[web] add a new script for clearing institution notifications

GitOrigin-RevId: d102b484c4fb9816832b48c2dfa66953bc996667
2021-10-21 08:03:25 +00:00
Brian Gough
acc9a1ace1 Merge pull request #5468 from overleaf/bg-fix-feature-override-script
fix feature override script

GitOrigin-RevId: f123843e1ed40b90f55a32d687a2ade4a5b44a05
2021-10-19 08:03:04 +00:00
Brian Gough
d2c76b05cf Merge pull request #5425 from overleaf/bg-add-feature-override-script
add feature override script

GitOrigin-RevId: 90def174b4ac182b6f62984e8f9621f3dc16b92d
2021-10-14 08:03:18 +00:00
Thomas
d984e3d826 Project history upgrade script for None without SL history (#4814)
GitOrigin-RevId: 604fb8a8193b798be1a342af5f08c004eee5521b
2021-10-08 08:03:00 +00:00
June Kelly
49ac6e2e6b Merge pull request #4929 from overleaf/jk-fix-disconnect-users
Fix /disconnectAllUsers endpoint security

GitOrigin-RevId: 57858daa5a076c37332bc575e76ffd6b1a1bd914
2021-09-27 08:02:57 +00:00
Thomas
3361ccfec1 Merge pull request #5123 from overleaf/tm-history-script-await-fix
Add missing await in history scripts

GitOrigin-RevId: 992e6748bc270845282853db6ec1a7aa496115ea
2021-09-24 08:04:08 +00:00
Eric Mc Sween
0f7bfe9173 Merge pull request #5087 from overleaf/em-promisify-subscription-updater
Promisify FeaturesUpdater and SubscriptionHandler

GitOrigin-RevId: 1a9725afa119c0eaee3d975a11197b6f702f1307
2021-09-21 08:03:10 +00:00
Hugh O'Brien
f7900b474b Merge pull request #4799 from overleaf/hb-eslint-rules
Re-enable some eslint rules

GitOrigin-RevId: 16153adb839bb61784bb40fbc8e43da281fe090d
2021-09-15 08:03:43 +00:00
Thomas
deca6f1f93 Add script to upgrade v1 project histories (if created after full project history enabled) (#4712)
GitOrigin-RevId: b329b83ae4167c3c58b947936d6a460f6f2b4327
2021-08-27 08:03:46 +00:00
June Kelly
af9a3d4fb7 Merge pull request #4818 from overleaf/ab-clean-example-project-split-test
Cleanup example project split test and set variant as new template

GitOrigin-RevId: 6d023233077b856f0f9a755eb1a0b60b66b4335f
2021-08-20 08:03:09 +00:00
Jakob Ackermann
75a602ec29 Merge pull request #4813 from overleaf/jpa-debug-non-pro
[web] check_institution_users: add option for debugging non pro users

GitOrigin-RevId: 11743e10a8be567028611d7e109c0450b08e11fc
2021-08-19 08:03:02 +00:00
Eric Mc Sween
b2e6eaf936 Merge pull request #4805 from overleaf/em-cleanup-expired-projects
Limit cleanup script to expired projects

GitOrigin-RevId: 49ea2c08cee92f027f21e3e8b07bf9491a9f089f
2021-08-19 08:02:49 +00:00
Eric Mc Sween
91e3f89154 Merge pull request #4796 from overleaf/em-cleanup-expired-projects
Script to clean up incorrectly expired projects

GitOrigin-RevId: e87860410c747385d76b4826fb38b58cb30e4973
2021-08-18 08:03:00 +00:00
Jakob Ackermann
99a414f345 Merge pull request #4656 from overleaf/jpa-rewrite-quotes-in-locales
[misc] rewrite single quote to left/right single quotation mark in locales

GitOrigin-RevId: a021fb6841425555b9af79a9146820299cb93fc2
2021-08-17 08:04:49 +00:00
Jakob Ackermann
7dc6456dca Merge pull request #4685 from overleaf/jpa-translations-sync
[misc] update translations sync for monorepo

GitOrigin-RevId: 794a9192212f7b63c040a08c42a1e9c6b3341609
2021-08-13 12:59:12 +00:00
Thomas
e25d8b1440 Merge pull request #4381 from overleaf/tm-history-upgrade-batched-update-hints
Extend batchedUpdate to accept find() options, and use a hint in upgrade script query to suggest mongo uses the _id index

GitOrigin-RevId: 7115f84d8be0c78ccb443051e911c931bf4aa0de
2021-08-05 02:08:07 +00:00
June Kelly
99fe2eca51 Merge pull request #4352 from overleaf/sk-add-ce-sp-migration-deleted-files
Add migrations for CE/SP, run scripts for deleted files and docs

GitOrigin-RevId: e425a8d929a4aefdc6f61cff636fb5a1b4c67dce
2021-08-04 11:13:55 +00:00
Thomas
ebc80fed8a Add script to upgrade v1 project histories (if no SL history) (#4364)
* Add script to upgrade v1 project histories (if no SL history)

GitOrigin-RevId: 997308eec2ed09be4d9d203cb746ca8ac8c88e23
2021-08-04 02:05:35 +00:00
nate stemen
7e61fc4035 Merge pull request #4330 from overleaf/ns-update-confirmedAt_strings
migrate confirmedAt strings to date types

GitOrigin-RevId: 5e8bde9b52b6696ed89a34ce58f00f31a921a57a
2021-07-28 02:07:11 +00:00
Jessica Lawshe
9df283caef Merge pull request #4334 from overleaf/jel-check-institution-users
Change check_institution_users.js output

GitOrigin-RevId: c331d5312dc807fd5118f4ce78737bde04a82c66
2021-07-28 02:07:03 +00:00
Thomas
b03a4cf7fc Add script to count project history states (#4328)
GitOrigin-RevId: 9f5fce9e162140579841cdad8a2ebb168dde72af
2021-07-28 02:06:24 +00:00
Jakob Ackermann
22aad599ba Merge pull request #4308 from overleaf/bg-allow-creating-projects-with-old-history
add script to create projects with sharelatex history

GitOrigin-RevId: bc5eae5d16cc65fca60b9155b35b7f5e2c663870
2021-07-14 12:40:47 +00:00