Commit graph

282 commits

Author SHA1 Message Date
Jakob Ackermann
d1c2c46224 Merge pull request #11266 from overleaf/jpa-translations-sync-debugging
[web] scripts: verbose logging in upload script

GitOrigin-RevId: dbc8793358fee63dabf1d5a9b80c3613a147a53b
2023-01-17 09:04:20 +00:00
Jakob Ackermann
0b7e28432d Merge pull request #11144 from overleaf/jpa-translations-helper-scripts
[web] scripts: add script for checking coverage of non-en translations

GitOrigin-RevId: ccde0d5b56b9e3b8f2a32916ecf1b442482edd12
2023-01-13 09:03:58 +00:00
Jakob Ackermann
b91f43f4f2 Merge pull request #11121 from overleaf/jpa-cleanup-en-locales
[web] locales: cleanup unused locales and check on it in CI

GitOrigin-RevId: 7625047f1731ec627df43bb9eb00348f110eadaf
2023-01-13 09:03:50 +00:00
Jakob Ackermann
1ff186a738 Merge pull request #11087 from overleaf/jpa-sort-locales
[web] sort all the locale files and check sorting in CI

GitOrigin-RevId: 5921e24f22e2ca126f7d49a1956b44d810b52dcd
2023-01-10 09:04:22 +00:00
Alexandre Bourdin
971dabb1f8 Merge pull request #9116 from overleaf/ab-script-group-membership-sync
[web] Script & cron job to synchronize group subscriptions memberships in BQ

GitOrigin-RevId: 0180f7586eb520f37d4d600bcb8d3eeea36a538a
2022-12-21 09:05:42 +00:00
Brian Gough
20cd6a6dc1 Merge pull request #10921 from overleaf/bg-fix-script-name
fix script name in comments of recurly_prices.js

GitOrigin-RevId: 4a547018ba538af91abd28a5e72c7da7cdc28d45
2022-12-21 09:05:12 +00:00
Eric Mc Sween
38df974ce1 Merge pull request #10739 from overleaf/em-history-mongo-backend
Send a history id from web when creating a project

GitOrigin-RevId: dd1417ae734c76990931885df1864a81a9439da0
2022-12-07 09:03:51 +00:00
Eric Mc Sween
5083060fbb Merge pull request #10677 from overleaf/em-history-id-string
Represent history ids as strings instead of integers

GitOrigin-RevId: 18977195b65492836e570c571ec7e8c7e088612b
2022-12-02 09:04:29 +00:00
Jakob Ackermann
d4551dc7ce Merge pull request #10442 from overleaf/jpa-convert-archived-trashed
[web] add migration for convert_archived_state script

GitOrigin-RevId: aeea3601a0c5f96e978c3f2a85458687d6d6678e
2022-11-15 09:07:09 +00:00
Jessica Lawshe
c5d35bce0e Merge pull request #10260 from overleaf/jel-script-messages
[web] Update script logs

GitOrigin-RevId: 5f98ac127a87250d4d75c6092ea8c051ac9ab46a
2022-11-15 09:06:40 +00:00
Eric Mc Sween
8be8dd4cc0 Merge pull request #10402 from overleaf/bg-sync-plan-prices-to-recurly
script to sync prices to recurly

GitOrigin-RevId: c6659f749136a9aeb2f90631470e144e9d1180a8
2022-11-15 09:06:11 +00:00
Eric Mc Sween
c9f8080769 Merge pull request #10372 from overleaf/ii-adjust-plans-prices
Adjust plans prices and automate the process of generating the prices lists

GitOrigin-RevId: 06be1f9a26837ed9bb7eca598cd88b6288244338
2022-11-15 09:05:56 +00:00
Brian Gough
495dd9016d Merge pull request #10290 from overleaf/bg-clear-feedbacks-collection
add script to clear old messages from mongo feedbacks collection

GitOrigin-RevId: a4986f432a12e801f41ff9bdf11b8771ef2b601f
2022-11-07 09:03:25 +00:00
Timothée Alby
9ac016127d Merge pull request #9967 from overleaf/jpa-web-scripts-increase-timeouts
[web] scripts: increase mongo query timeouts by default (30s -> 5min)

GitOrigin-RevId: bdd1a504799ac1d42c52c3966b1072f721398e12
2022-10-18 08:03:06 +00:00
Eric Mc Sween
20a69289db Merge pull request #9961 from overleaf/em-fix-empty-name
Fix filetree entry with an empty name

GitOrigin-RevId: 2fecdde67954472e1d34bccc1ccf7015a0b98752
2022-10-14 08:04:33 +00:00
Alf Eaton
609483b4f0 Merge pull request #9963 from overleaf/msm-option-skip-audit
[scripts] option to skip user migration in `migrate_audit_logs`

GitOrigin-RevId: 738465abeca0d95a493bc3d805f4822dd29760a2
2022-10-14 08:04:07 +00:00
Eric Mc Sween
da30da76b2 Merge pull request #9894 from overleaf/em-node-fetch-web
Replace request-promise with node-fetch in web

GitOrigin-RevId: 07dbb6db7fd42326807aaeb18e5ee39f7c3d4668
2022-10-13 08:04:24 +00:00
Eric Mc Sween
a177872179 Merge pull request #9892 from overleaf/em-bad-filetrees
Add more ways to fix bad filetrees

GitOrigin-RevId: a60ab819fbd7c0547cf2d00022df71d4cba5cf9d
2022-10-12 08:04:21 +00:00
Miguel Serrano
b1937700cc Merge pull request #9864 from overleaf/msm-fix-audit-log
[scripts] fix audit log migration script

GitOrigin-RevId: a7e32217385ac66a899e34eb3e0e8373bc802944
2022-10-05 13:26:15 +00:00
Miguel Serrano
877638f09c [web/scripts] Process users' projects with promiseMapWithLimit() (#9807)
* [web/scripts] Process users' projects with `promiseMapWithLimit()`
* [web/scripts] Added several optimisations to migration script

GitOrigin-RevId: 0dd221a3a8b4bb64f412636faa17e81249ca6c4f
2022-10-05 08:04:02 +00:00
Brian Gough
51806703b7 Merge pull request #9819 from overleaf/bg-node-upgrade
upgrade from node 16.16.0 to 16.17.1

GitOrigin-RevId: e1db74d950ce452303212c66ce3fe06fbd1dfe59
2022-10-04 08:02:41 +00:00
Miguel Serrano
aefcf3c8bc Merge pull request #9795 from overleaf/msm-audit-log-migration-fix
[web/scripts] Fix audit log migration script

GitOrigin-RevId: 55c90520240bef92a4be1925809cac178c8b3ee9
2022-09-30 08:04:55 +00:00
Miguel Serrano
74f44e655a Merge pull request #9617 from overleaf/msm-audit-log-collections
Move project/user audit logs to their own collections

GitOrigin-RevId: f6f89b3e2815c0fe5691a79eceb35b77b3c370d8
2022-09-30 08:04:17 +00:00
Alf Eaton
7ce229be0c Merge pull request #9583 from overleaf/msm-script-project-size
[web] Script to count project sizes

GitOrigin-RevId: a8ff5e083147fe1ad288f1eff023984ae19e3a86
2022-09-16 08:05:24 +00:00
Eric Mc Sween
e3303bb276 Merge pull request #9409 from overleaf/em-send-more-metadata-to-tpds
Send more metadata to TPDS

GitOrigin-RevId: e6a76a9974fbd8a7fc6a6b861c88ff4728301bc3
2022-08-31 08:03:45 +00:00
Eric Mc Sween
8b2f8ce243 Merge pull request #9383 from overleaf/em-file-tree-histories
Track source for all file tree operations

GitOrigin-RevId: ff95ea8e99bfa30203a2a42968519bbaba65e708
2022-08-26 08:03:30 +00:00
Thomas
4198eb2789 Add script to delete projects from the command line for cleanup of ownerless projects (#9106)
* Add script for deleting projects via command line

GitOrigin-RevId: bc08e4a39986e9d43dd103a14c28b02ca9ce84d9
2022-08-09 08:02:49 +00:00
Alasdair Smith
6d89ab0377 Add script to delete orphaned doc comment ranges (#9086)
Add script to delete orphaned doc comment ranges

GitOrigin-RevId: c9ee92f791f8657ba0157cc843445c3cba144312
2022-08-05 08:04:14 +00:00
Jakob Ackermann
a31f30ed44 Merge pull request #9030 from overleaf/msm-update-allowdowngrade-script
[scripts] Change batching in `unset_allow_downgrade.js`

GitOrigin-RevId: 42542f1b2ca75d184cf2d812f3ebaf291a5992b6
2022-07-29 08:04:28 +00:00
Mathias Jakobsen
e0c23d83da [web] Add auditing of email removals (#8904)
* [web] Add auditing of email removals

* [web] Improve auditing of email removal from script

GitOrigin-RevId: ccb948f01616a0bcb2d8f718d6b9e69585e8bb89
2022-07-27 12:17:31 +00:00
Brian Gough
e7531eb047 Merge pull request #8871 from overleaf/briangough-issue8868
Upgrade node to v16.16.0

GitOrigin-RevId: 6bc6d63aa4af1940649f1eb5966f182250ecac22
2022-07-18 08:04:37 +00:00
Brian Gough
e32d1dbdd6 Merge pull request #8786 from overleaf/bg-check-age-for-migration
enforce cutoff date for track-changes history migration

GitOrigin-RevId: cd7b76281c66b7e6edc856d70660f2c5b8ae5275
2022-07-12 08:03:11 +00:00
Brian Gough
73f85d6e51 Merge pull request #8780 from overleaf/bg-import-zip-file-for-migration
import track-changes zip file from disk for history migration

GitOrigin-RevId: cb1d7f57e60ea6f627e63753c22f2ffc7e3b79ac
2022-07-12 08:03:05 +00:00
Brian Gough
a822819582 Merge pull request #8762 from overleaf/bg-force-new-history-on-failure
[web] allow forcing new history on migration failure

GitOrigin-RevId: bf84a6edf5a10b6aa3a1653e13a213552cb9272e
2022-07-12 08:03:02 +00:00
June Kelly
34a7d3598f Merge pull request #8787 from overleaf/msm-force-doc-flush
[web] script to force flushing docs to mongo

GitOrigin-RevId: 6ce3c1e456b92610fe4f90993b373db2070ab392
2022-07-11 08:04:42 +00:00
Miguel Serrano
88575dc58e Merge pull request #8735 from overleaf/msm-unset-allow-downgrade
[web] script to unset `history.allowDowngrade` in projects

GitOrigin-RevId: c30dfa64bfdd492d659cce308628f9e118449d5c
2022-07-08 08:03:43 +00:00
Brian Gough
5a3318f5b3 Merge pull request #8701 from overleaf/bg-simple-iterable-paths
simple iterable paths

GitOrigin-RevId: f6906016888ccfc95c88858bdac4d2633fc1c5f4
2022-07-05 08:03:43 +00:00
Brian Gough
be71ea690d Merge pull request #8687 from overleaf/bg-validate-migration-updates
[web] validate updates in history migration

GitOrigin-RevId: 35e11417ff83db81ad1dfd29165577e142e64f74
2022-07-05 08:03:32 +00:00
Brian Gough
da02a4f2be Merge pull request #8644 from overleaf/bg-archive-track-changes
archive track changes zip files in project when history migration fails

GitOrigin-RevId: 67f2381b0a8f2fb1de82100752031c65808af885
2022-07-01 08:03:52 +00:00
Brian Gough
496f283892 Merge pull request #8544 from overleaf/bg-fix-log-message
fix message in downgrade_project script

GitOrigin-RevId: 9619f1122d1d242a1f3cfd7e07c7ddfd908e340e
2022-06-24 08:03:40 +00:00
Brian Gough
b0d48c49f2 Merge pull request #8536 from overleaf/bg-downgrade-history-script
[scripts] downgrade history for a project

GitOrigin-RevId: 620440482e176404529edcbe89d696970bdc5652
2022-06-23 08:02:32 +00:00
June Kelly
a450a74351 Upgrade async package to 3.2.2 (#8447)
* Revert "Revert "Bump async to 3.2.2 (#7618)""

This reverts commit 75153a555211d654744c2e61e27fe21085826c22.

* [web] fix usage of async.queue.drain in script

* [clsi] fix usage of async.queue.drain

* [spelling] fix usage of async.queue.drain

* [redis-wrapper] fix usage of async.queue.drain

* [web] Test that LockManager queue is cleared

This protects against a regression found when upgrading the
async package. Here we test that the `queue.drain` callback
is really getting called, and the lock is being removed from
the LOCK_QUEUES map.

* [redis-wrapper] Upgrade async to 3.2.2

GitOrigin-RevId: df921e6d7f1d505bd467f22e58600ba1aff48869
2022-06-22 08:03:35 +00:00
Miguel Serrano
1c78e211f6 Merge pull request #8513 from overleaf/msm-fix-conversion-typo
[web] fixed env names in scripts

GitOrigin-RevId: 3989514b23773642d4834ffca12cf97c756ade4c
2022-06-21 08:03:17 +00:00
Miguel Serrano
e7c8329491 Merge pull request #8492 from overleaf/msm-history-migration-convert-large-docs
[web] Updated history upgrade scripts to move large docs to filestore

GitOrigin-RevId: 11ac9fc879ff03756e3ec41bb156e878c4223014
2022-06-21 08:03:13 +00:00
Brian Gough
bc31247d24 Merge pull request #8471 from overleaf/bg-ignore-upgradefailed-when-history-does-not-exist
[scripts] allow history upgrade in failure case

GitOrigin-RevId: 7c789968bd74719e3a0232422094ae3e9231a044
2022-06-20 08:04:17 +00:00
Davinder Singh
ff6c88de0c Merge pull request #8452 from overleaf/jel-check-emails-script
[web] Check users concurrently

GitOrigin-RevId: 2bca99c5b6b84ddb71b0f96c412238ecffa0f953
2022-06-17 08:03:22 +00:00
Timothée Alby
34bc2ac9ec Merge pull request #8402 from overleaf/msm-history-conversion-script
[web] Allow running history conversion script on single project

GitOrigin-RevId: 799d0a00e2ebabe6c7bbfd6bdbdb58a6025ce53f
2022-06-15 08:04:30 +00:00
Timothée Alby
343cfe4f06 Merge pull request #8360 from overleaf/jel-remove-not-needed-script
[web] Remove SAML backfill update script

GitOrigin-RevId: 5166ced7657ddc24c99bbd0873874e5c01bbab0f
2022-06-15 08:04:05 +00:00
Brian Gough
baa2d08b7f Merge pull request #8340 from overleaf/bg-one-shot-migration-script
[web] allow running history conversion script on single project

GitOrigin-RevId: 038005605a048d97d3fabcfa16b1c2421094e2e5
2022-06-10 08:03:31 +00:00
Timothée Alby
d94478b4a8 Merge pull request #8268 from overleaf/jel-script-check-emails
[web and v1] Script to check SAML emails

GitOrigin-RevId: 9c411858cdd4c2cc41ce8a7d4aa4228b98654c85
2022-06-09 08:02:39 +00:00