Commit graph

419 commits

Author SHA1 Message Date
Eric Mc Sween
21971956b7 Merge pull request #12219 from overleaf/em-camel-case-web
Camel case variables in web

GitOrigin-RevId: 28e61b759b27f71265f33ab64f588374dba610e0
2023-03-22 09:05:04 +00:00
Jakob Ackermann
03f45c02c3 Merge pull request #12276 from overleaf/jpa-batched-update-window
[web] add time based window queries to batchedUpdate

GitOrigin-RevId: e56c01b888cd9749f39d42b77de09bc3fe2d0ec1
2023-03-22 09:04:09 +00:00
Miguel Serrano
eb5f184377 Merge pull request #12272 from overleaf/bg-remove-doc-history-count
remove doc history count from history migration

GitOrigin-RevId: ab0ed685577de2fb5f9786981e5df5198d595c62
2023-03-17 09:06:23 +00:00
Jakob Ackermann
fa5804a3cf Merge pull request #12254 from overleaf/jpa-back-fill-doc-rev
[web] add script for back filling rev=1 for old (deleted) docs

GitOrigin-RevId: 62f5b773fb83ddbf9bb202a592ce2e8f33b5e6b2
2023-03-17 09:03:58 +00:00
Brian Gough
9276ba87b2 Merge pull request #12121 from overleaf/bg-fix-bad-offsets-in-history-migration
fix out of range offsets to avoid invalid history exports

GitOrigin-RevId: d00e3e9e08feb6c3be671b5805102a66782b3f92
2023-03-08 09:04:00 +00:00
Brian Gough
38973fb971 Merge pull request #12098 from overleaf/bg-fix-debug-history-script
fix incorrect log.op call in debug_history script

GitOrigin-RevId: 363fa9072493895003c8e506e6e2545ab5e89f00
2023-03-06 09:05:08 +00:00
Brian Gough
61e8dba859 Merge pull request #12075 from overleaf/bg-track-changes-debug-unmigrated
add option to check history of unmigrated projects

GitOrigin-RevId: c27a7b5227cb10603ae8e9d8136859a158caaf8a
2023-03-06 09:04:16 +00:00
Brian Gough
b7527ab6fe Merge pull request #12071 from overleaf/bg-track-changes-debug-script
track-changes debug script for history migration

GitOrigin-RevId: c95b3b4e3bdfd7c75751caae8ff37838e4a78511
2023-03-03 09:03:51 +00:00
Eric Mc Sween
65976cb363 Merge pull request #11869 from overleaf/em-upgrade-mongoose-web
Upgrade Mongoose and the Mongo driver in web

GitOrigin-RevId: 2cad1aabe57eae424a9e4c68b2e0062f0e78ffaf
2023-03-01 09:03:27 +00:00
ilkin-overleaf
3472a82ac9 Merge pull request #11960 from overleaf/jk-script-to-remove-oauth-application
[web] script to remove oauthApplication record

GitOrigin-RevId: d217bec8d4b271ec8007ea90c0fde5e8f7e3fe52
2023-03-01 09:02:59 +00:00
June Kelly
85a83c143e Merge pull request #11921 from overleaf/jk-gitbridge-rotate-oauth-app-staging
[ops] change git-bridge oauth id/secret in staging

GitOrigin-RevId: bffc6ad7c75fe2831b26ec95477bec3bca8c4d93
2023-02-24 09:04:03 +00:00
Jakob Ackermann
dd906df7b7 Merge pull request #11360 from overleaf/jpa-encrypt-2fa-secret
[web] two-factor-authentication: encrypt the secret in the db

GitOrigin-RevId: 86642e13d917b239012229f685ad0210039a6706
2023-02-17 09:03:44 +00:00
Jakob Ackermann
79f7d259e9 Merge pull request #11833 from overleaf/jpa-v2-fallback
[access-token-encryptor] scripts: fallback version to v2

GitOrigin-RevId: 232e6b1f6b8667a58c5fd0f5caf604209f100809
2023-02-16 09:04:39 +00:00
Jakob Ackermann
d06a578492 Merge pull request #11816 from overleaf/jpa-re-encrypt-v2
[access-token-encryptor] flag v2 tokens for re-encryption

GitOrigin-RevId: 4ccb6d220d74a821f2fef8c72267f174cc2c502f
2023-02-16 09:04:31 +00:00
Thomas
c52799798d Merge pull request #11781 from overleaf/tm-merge-group-subscription-members-script
Add script to merge group subscription members

GitOrigin-RevId: 4a3633320624e0c0514ed58cf792f2a921b0867a
2023-02-14 09:04:01 +00:00
Mathias Jakobsen
6e421f8754 Merge pull request #11765 from overleaf/mj-count-images
[web] Add script for counting images in Mongo

GitOrigin-RevId: 1f2795d73d9afa0f0ae46b1e29a03a93b1d85ee5
2023-02-10 16:33:22 +00:00
Thomas
6ca86168b1 Merge pull request #11741 from overleaf/tm-fix-foreach-invite-email-lowercase-script
Bugfix for script to fix lowercase emails in group invites

GitOrigin-RevId: f8581376fa5dde2fe057f0e988e5921de7446612
2023-02-09 09:06:22 +00:00
Thomas
6811b9085a Merge pull request #11709 from overleaf/jpa-cleanup-more-locales
[web] scripts: translations: exclude more places from i18n tracking

GitOrigin-RevId: bd2204c59b73638358348c0742cc3b2cb45f248a
2023-02-09 09:04:05 +00:00
Thomas
c7d3cb0561 Merge pull request #11710 from overleaf/tm-invite-emails-lowercase-await-fix
Adds missing await on async db update

GitOrigin-RevId: 149cb4dad1b29d4ce409039087ab9c9dbbaae635
2023-02-09 09:03:40 +00:00
Jakob Ackermann
663aace586 Merge pull request #11674 from overleaf/jpa-check-extracted-translations-in-ci
[web] check extracted translations in CI

GitOrigin-RevId: 27e13f5fd1fe08db65b68ffbff639adb83d99f74
2023-02-08 09:06:06 +00:00
Mathias Jakobsen
9ff8d93ab8 Merge pull request #11669 from overleaf/tm-group-invite-emails-to-lowercase
Add migration that normalises group invite emails to lowercase

GitOrigin-RevId: 6352848b2bf13b2eb00ce5c9bff21a3f421c82b6
2023-02-08 09:05:52 +00:00
Miguel Serrano
89dd3b94b1 Merge pull request #11663 from overleaf/bg-add-migration-force-options
add migration force options

GitOrigin-RevId: 51eb88e995a6e348e00208e9d01c9c1fa6c0c1ea
2023-02-07 09:55:15 +00:00
Miguel Serrano
832a0facba Merge pull request #11658 from overleaf/bg-add-concurrency-to-migration
add concurrency to the history migration script

GitOrigin-RevId: 059a1a8b402627b03cb6dab79b5da22189f32704
2023-02-07 09:55:07 +00:00
Miguel Serrano
f8bc3b3357 Merge pull request #11641 from overleaf/bg-improve-migration-script
improve history migration script

GitOrigin-RevId: bd1b4263ccb3d10f0c9d741e4f11671cf307cd58
2023-02-07 09:54:58 +00:00
Miguel Serrano
df3aff9c66 Merge pull request #11629 from overleaf/msm-exit-migrate-history
[web/scripts] force exit on `migrate_history.js`

GitOrigin-RevId: 298568043c2885b8ad2c6242e7519faccf2f2498
2023-02-02 18:23:08 +00:00
Brian Gough
f996c95165 Merge pull request #11593 from overleaf/bg-create-project-with-random-history
extend the create_project script to include history

GitOrigin-RevId: 74084731d72337eecd933a31212000f64026df8b
2023-02-02 18:22:09 +00:00
Jakob Ackermann
f532abfd1c Merge pull request #11561 from overleaf/jpa-fix-count-script
[web] scripts: count_encrypted_access_tokens: fix printing of stats

GitOrigin-RevId: 43a709c00cc5adfcf133c9f826152b9f586c3c68
2023-02-02 09:02:53 +00:00
Jakob Ackermann
9e6a767c96 Merge pull request #11544 from overleaf/jpa-re-encrypt-access-tokens
[misc] add scripts for rotating all the encrypted access-tokens

GitOrigin-RevId: ce3374bb5d318a7f16a416ac1719a819c1160fb4
2023-02-01 09:03:56 +00:00
Miguel Serrano
cefdc78c6e Merge pull request #11550 from overleaf/msm-migrate-history-count-fix
[web/scripts] fix error count in `migrate_history.js`

GitOrigin-RevId: d7326c4e25913969f196276c913e70a03398f3ac
2023-01-31 10:35:27 +00:00
Brian Gough
56cb937672 Merge pull request #11529 from overleaf/bg-report-whole-error
log the full result from history migrations

GitOrigin-RevId: 55aaa7bbd88a61234dcf1247ddbf8af543fc4bc1
2023-01-31 09:03:53 +00:00
Miguel Serrano
6787e9c50d Merge pull request #11490 from overleaf/msm-migrate-history-fix
[web/scripts] `history/migrate_history.js` fixes

GitOrigin-RevId: 249e9a3f1dbf89d46335ee208f5922905477845c
2023-01-27 12:04:01 +00:00
Jakob Ackermann
6a628be198 Merge pull request #11452 from overleaf/jpa-count-tokens
[web] scripts: add a script for counting encrypted access tokens in db

GitOrigin-RevId: 54478a7513c3e33cc25e8a8779d09e84a3db790e
2023-01-27 09:04:20 +00:00
Eric Mc Sween
deb7d82e68 Merge pull request #11435 from overleaf/em-price-increase-script
Script to increase prices for existing customers

GitOrigin-RevId: 8b5357b05a9f09f2ed1b2b52f5dff8d296d06bf3
2023-01-26 09:04:21 +00:00
Eric Mc Sween
b11cb7d1e9 Merge pull request #11390 from overleaf/jpa-cleanup-sessions
[web] scripts: add a script for cleaning up sessions with 2fa artifact

GitOrigin-RevId: 134c2ad2c96defa54e89bbed7d7b20005c803aea
2023-01-24 09:05:20 +00:00
Brian Gough
78360b7358 initial history migration script (#11359)
* initial history migration script

* fix case in migration script

GitOrigin-RevId: cd2786605120e998c3b01bfeae436c2fbf7da0fa
2023-01-24 09:03:50 +00:00
Miguel Serrano
1a0e1def66 Merge pull request #11280 from overleaf/bg-issue11277
Move history migration logic to web module

GitOrigin-RevId: 6f1ba33519277b9ba13ecb2a13ae2c43ee06f675
2023-01-24 09:03:43 +00:00
Jakob Ackermann
dea52fec6f Merge pull request #11270 from overleaf/jpa-retry-translations-upload
[web] scripts: add retry to translations upload script

GitOrigin-RevId: b67af0def876d5e1dd0478e7b8fcd234bfc05447
2023-01-17 09:04:51 +00:00
Jakob Ackermann
d1c2c46224 Merge pull request #11266 from overleaf/jpa-translations-sync-debugging
[web] scripts: verbose logging in upload script

GitOrigin-RevId: dbc8793358fee63dabf1d5a9b80c3613a147a53b
2023-01-17 09:04:20 +00:00
Jakob Ackermann
0b7e28432d Merge pull request #11144 from overleaf/jpa-translations-helper-scripts
[web] scripts: add script for checking coverage of non-en translations

GitOrigin-RevId: ccde0d5b56b9e3b8f2a32916ecf1b442482edd12
2023-01-13 09:03:58 +00:00
Jakob Ackermann
b91f43f4f2 Merge pull request #11121 from overleaf/jpa-cleanup-en-locales
[web] locales: cleanup unused locales and check on it in CI

GitOrigin-RevId: 7625047f1731ec627df43bb9eb00348f110eadaf
2023-01-13 09:03:50 +00:00
Jakob Ackermann
1ff186a738 Merge pull request #11087 from overleaf/jpa-sort-locales
[web] sort all the locale files and check sorting in CI

GitOrigin-RevId: 5921e24f22e2ca126f7d49a1956b44d810b52dcd
2023-01-10 09:04:22 +00:00
Alexandre Bourdin
971dabb1f8 Merge pull request #9116 from overleaf/ab-script-group-membership-sync
[web] Script & cron job to synchronize group subscriptions memberships in BQ

GitOrigin-RevId: 0180f7586eb520f37d4d600bcb8d3eeea36a538a
2022-12-21 09:05:42 +00:00
Brian Gough
20cd6a6dc1 Merge pull request #10921 from overleaf/bg-fix-script-name
fix script name in comments of recurly_prices.js

GitOrigin-RevId: 4a547018ba538af91abd28a5e72c7da7cdc28d45
2022-12-21 09:05:12 +00:00
Eric Mc Sween
38df974ce1 Merge pull request #10739 from overleaf/em-history-mongo-backend
Send a history id from web when creating a project

GitOrigin-RevId: dd1417ae734c76990931885df1864a81a9439da0
2022-12-07 09:03:51 +00:00
Eric Mc Sween
5083060fbb Merge pull request #10677 from overleaf/em-history-id-string
Represent history ids as strings instead of integers

GitOrigin-RevId: 18977195b65492836e570c571ec7e8c7e088612b
2022-12-02 09:04:29 +00:00
Jakob Ackermann
d4551dc7ce Merge pull request #10442 from overleaf/jpa-convert-archived-trashed
[web] add migration for convert_archived_state script

GitOrigin-RevId: aeea3601a0c5f96e978c3f2a85458687d6d6678e
2022-11-15 09:07:09 +00:00
Jessica Lawshe
c5d35bce0e Merge pull request #10260 from overleaf/jel-script-messages
[web] Update script logs

GitOrigin-RevId: 5f98ac127a87250d4d75c6092ea8c051ac9ab46a
2022-11-15 09:06:40 +00:00
Eric Mc Sween
8be8dd4cc0 Merge pull request #10402 from overleaf/bg-sync-plan-prices-to-recurly
script to sync prices to recurly

GitOrigin-RevId: c6659f749136a9aeb2f90631470e144e9d1180a8
2022-11-15 09:06:11 +00:00
Eric Mc Sween
c9f8080769 Merge pull request #10372 from overleaf/ii-adjust-plans-prices
Adjust plans prices and automate the process of generating the prices lists

GitOrigin-RevId: 06be1f9a26837ed9bb7eca598cd88b6288244338
2022-11-15 09:05:56 +00:00
Brian Gough
495dd9016d Merge pull request #10290 from overleaf/bg-clear-feedbacks-collection
add script to clear old messages from mongo feedbacks collection

GitOrigin-RevId: a4986f432a12e801f41ff9bdf11b8771ef2b601f
2022-11-07 09:03:25 +00:00
Timothée Alby
9ac016127d Merge pull request #9967 from overleaf/jpa-web-scripts-increase-timeouts
[web] scripts: increase mongo query timeouts by default (30s -> 5min)

GitOrigin-RevId: bdd1a504799ac1d42c52c3966b1072f721398e12
2022-10-18 08:03:06 +00:00
Eric Mc Sween
20a69289db Merge pull request #9961 from overleaf/em-fix-empty-name
Fix filetree entry with an empty name

GitOrigin-RevId: 2fecdde67954472e1d34bccc1ccf7015a0b98752
2022-10-14 08:04:33 +00:00
Alf Eaton
609483b4f0 Merge pull request #9963 from overleaf/msm-option-skip-audit
[scripts] option to skip user migration in `migrate_audit_logs`

GitOrigin-RevId: 738465abeca0d95a493bc3d805f4822dd29760a2
2022-10-14 08:04:07 +00:00
Eric Mc Sween
da30da76b2 Merge pull request #9894 from overleaf/em-node-fetch-web
Replace request-promise with node-fetch in web

GitOrigin-RevId: 07dbb6db7fd42326807aaeb18e5ee39f7c3d4668
2022-10-13 08:04:24 +00:00
Eric Mc Sween
a177872179 Merge pull request #9892 from overleaf/em-bad-filetrees
Add more ways to fix bad filetrees

GitOrigin-RevId: a60ab819fbd7c0547cf2d00022df71d4cba5cf9d
2022-10-12 08:04:21 +00:00
Miguel Serrano
b1937700cc Merge pull request #9864 from overleaf/msm-fix-audit-log
[scripts] fix audit log migration script

GitOrigin-RevId: a7e32217385ac66a899e34eb3e0e8373bc802944
2022-10-05 13:26:15 +00:00
Miguel Serrano
877638f09c [web/scripts] Process users' projects with promiseMapWithLimit() (#9807)
* [web/scripts] Process users' projects with `promiseMapWithLimit()`
* [web/scripts] Added several optimisations to migration script

GitOrigin-RevId: 0dd221a3a8b4bb64f412636faa17e81249ca6c4f
2022-10-05 08:04:02 +00:00
Brian Gough
51806703b7 Merge pull request #9819 from overleaf/bg-node-upgrade
upgrade from node 16.16.0 to 16.17.1

GitOrigin-RevId: e1db74d950ce452303212c66ce3fe06fbd1dfe59
2022-10-04 08:02:41 +00:00
Miguel Serrano
aefcf3c8bc Merge pull request #9795 from overleaf/msm-audit-log-migration-fix
[web/scripts] Fix audit log migration script

GitOrigin-RevId: 55c90520240bef92a4be1925809cac178c8b3ee9
2022-09-30 08:04:55 +00:00
Miguel Serrano
74f44e655a Merge pull request #9617 from overleaf/msm-audit-log-collections
Move project/user audit logs to their own collections

GitOrigin-RevId: f6f89b3e2815c0fe5691a79eceb35b77b3c370d8
2022-09-30 08:04:17 +00:00
Alf Eaton
7ce229be0c Merge pull request #9583 from overleaf/msm-script-project-size
[web] Script to count project sizes

GitOrigin-RevId: a8ff5e083147fe1ad288f1eff023984ae19e3a86
2022-09-16 08:05:24 +00:00
Eric Mc Sween
e3303bb276 Merge pull request #9409 from overleaf/em-send-more-metadata-to-tpds
Send more metadata to TPDS

GitOrigin-RevId: e6a76a9974fbd8a7fc6a6b861c88ff4728301bc3
2022-08-31 08:03:45 +00:00
Eric Mc Sween
8b2f8ce243 Merge pull request #9383 from overleaf/em-file-tree-histories
Track source for all file tree operations

GitOrigin-RevId: ff95ea8e99bfa30203a2a42968519bbaba65e708
2022-08-26 08:03:30 +00:00
Thomas
4198eb2789 Add script to delete projects from the command line for cleanup of ownerless projects (#9106)
* Add script for deleting projects via command line

GitOrigin-RevId: bc08e4a39986e9d43dd103a14c28b02ca9ce84d9
2022-08-09 08:02:49 +00:00
Alasdair Smith
6d89ab0377 Add script to delete orphaned doc comment ranges (#9086)
Add script to delete orphaned doc comment ranges

GitOrigin-RevId: c9ee92f791f8657ba0157cc843445c3cba144312
2022-08-05 08:04:14 +00:00
Jakob Ackermann
a31f30ed44 Merge pull request #9030 from overleaf/msm-update-allowdowngrade-script
[scripts] Change batching in `unset_allow_downgrade.js`

GitOrigin-RevId: 42542f1b2ca75d184cf2d812f3ebaf291a5992b6
2022-07-29 08:04:28 +00:00
Mathias Jakobsen
e0c23d83da [web] Add auditing of email removals (#8904)
* [web] Add auditing of email removals

* [web] Improve auditing of email removal from script

GitOrigin-RevId: ccb948f01616a0bcb2d8f718d6b9e69585e8bb89
2022-07-27 12:17:31 +00:00
Brian Gough
e7531eb047 Merge pull request #8871 from overleaf/briangough-issue8868
Upgrade node to v16.16.0

GitOrigin-RevId: 6bc6d63aa4af1940649f1eb5966f182250ecac22
2022-07-18 08:04:37 +00:00
Brian Gough
e32d1dbdd6 Merge pull request #8786 from overleaf/bg-check-age-for-migration
enforce cutoff date for track-changes history migration

GitOrigin-RevId: cd7b76281c66b7e6edc856d70660f2c5b8ae5275
2022-07-12 08:03:11 +00:00
Brian Gough
73f85d6e51 Merge pull request #8780 from overleaf/bg-import-zip-file-for-migration
import track-changes zip file from disk for history migration

GitOrigin-RevId: cb1d7f57e60ea6f627e63753c22f2ffc7e3b79ac
2022-07-12 08:03:05 +00:00
Brian Gough
a822819582 Merge pull request #8762 from overleaf/bg-force-new-history-on-failure
[web] allow forcing new history on migration failure

GitOrigin-RevId: bf84a6edf5a10b6aa3a1653e13a213552cb9272e
2022-07-12 08:03:02 +00:00
June Kelly
34a7d3598f Merge pull request #8787 from overleaf/msm-force-doc-flush
[web] script to force flushing docs to mongo

GitOrigin-RevId: 6ce3c1e456b92610fe4f90993b373db2070ab392
2022-07-11 08:04:42 +00:00
Miguel Serrano
88575dc58e Merge pull request #8735 from overleaf/msm-unset-allow-downgrade
[web] script to unset `history.allowDowngrade` in projects

GitOrigin-RevId: c30dfa64bfdd492d659cce308628f9e118449d5c
2022-07-08 08:03:43 +00:00
Brian Gough
5a3318f5b3 Merge pull request #8701 from overleaf/bg-simple-iterable-paths
simple iterable paths

GitOrigin-RevId: f6906016888ccfc95c88858bdac4d2633fc1c5f4
2022-07-05 08:03:43 +00:00
Brian Gough
be71ea690d Merge pull request #8687 from overleaf/bg-validate-migration-updates
[web] validate updates in history migration

GitOrigin-RevId: 35e11417ff83db81ad1dfd29165577e142e64f74
2022-07-05 08:03:32 +00:00
Brian Gough
da02a4f2be Merge pull request #8644 from overleaf/bg-archive-track-changes
archive track changes zip files in project when history migration fails

GitOrigin-RevId: 67f2381b0a8f2fb1de82100752031c65808af885
2022-07-01 08:03:52 +00:00
Brian Gough
496f283892 Merge pull request #8544 from overleaf/bg-fix-log-message
fix message in downgrade_project script

GitOrigin-RevId: 9619f1122d1d242a1f3cfd7e07c7ddfd908e340e
2022-06-24 08:03:40 +00:00
Brian Gough
b0d48c49f2 Merge pull request #8536 from overleaf/bg-downgrade-history-script
[scripts] downgrade history for a project

GitOrigin-RevId: 620440482e176404529edcbe89d696970bdc5652
2022-06-23 08:02:32 +00:00
June Kelly
a450a74351 Upgrade async package to 3.2.2 (#8447)
* Revert "Revert "Bump async to 3.2.2 (#7618)""

This reverts commit 75153a555211d654744c2e61e27fe21085826c22.

* [web] fix usage of async.queue.drain in script

* [clsi] fix usage of async.queue.drain

* [spelling] fix usage of async.queue.drain

* [redis-wrapper] fix usage of async.queue.drain

* [web] Test that LockManager queue is cleared

This protects against a regression found when upgrading the
async package. Here we test that the `queue.drain` callback
is really getting called, and the lock is being removed from
the LOCK_QUEUES map.

* [redis-wrapper] Upgrade async to 3.2.2

GitOrigin-RevId: df921e6d7f1d505bd467f22e58600ba1aff48869
2022-06-22 08:03:35 +00:00
Miguel Serrano
1c78e211f6 Merge pull request #8513 from overleaf/msm-fix-conversion-typo
[web] fixed env names in scripts

GitOrigin-RevId: 3989514b23773642d4834ffca12cf97c756ade4c
2022-06-21 08:03:17 +00:00
Miguel Serrano
e7c8329491 Merge pull request #8492 from overleaf/msm-history-migration-convert-large-docs
[web] Updated history upgrade scripts to move large docs to filestore

GitOrigin-RevId: 11ac9fc879ff03756e3ec41bb156e878c4223014
2022-06-21 08:03:13 +00:00
Brian Gough
bc31247d24 Merge pull request #8471 from overleaf/bg-ignore-upgradefailed-when-history-does-not-exist
[scripts] allow history upgrade in failure case

GitOrigin-RevId: 7c789968bd74719e3a0232422094ae3e9231a044
2022-06-20 08:04:17 +00:00
Davinder Singh
ff6c88de0c Merge pull request #8452 from overleaf/jel-check-emails-script
[web] Check users concurrently

GitOrigin-RevId: 2bca99c5b6b84ddb71b0f96c412238ecffa0f953
2022-06-17 08:03:22 +00:00
Timothée Alby
34bc2ac9ec Merge pull request #8402 from overleaf/msm-history-conversion-script
[web] Allow running history conversion script on single project

GitOrigin-RevId: 799d0a00e2ebabe6c7bbfd6bdbdb58a6025ce53f
2022-06-15 08:04:30 +00:00
Timothée Alby
343cfe4f06 Merge pull request #8360 from overleaf/jel-remove-not-needed-script
[web] Remove SAML backfill update script

GitOrigin-RevId: 5166ced7657ddc24c99bbd0873874e5c01bbab0f
2022-06-15 08:04:05 +00:00
Brian Gough
baa2d08b7f Merge pull request #8340 from overleaf/bg-one-shot-migration-script
[web] allow running history conversion script on single project

GitOrigin-RevId: 038005605a048d97d3fabcfa16b1c2421094e2e5
2022-06-10 08:03:31 +00:00
Timothée Alby
d94478b4a8 Merge pull request #8268 from overleaf/jel-script-check-emails
[web and v1] Script to check SAML emails

GitOrigin-RevId: 9c411858cdd4c2cc41ce8a7d4aa4228b98654c85
2022-06-09 08:02:39 +00:00
Miguel Serrano
c5f93bedea Merge pull request #8335 from overleaf/msm-fix-reset-rev-script
Fixed `reset_incorrect_doc_revision.js` script

GitOrigin-RevId: 59448881e372ca7ca6f3b50f76cab5476279a1ab
2022-06-09 08:02:23 +00:00
Miguel Serrano
3238694daa [web] Reset incorrect doc.rev value (#8331)
* [web] Reset incorrect `doc.rev` value

* Applied logging suggestions

GitOrigin-RevId: 6381fea438cf7409845d7a69c5d24e46cbec42c3
2022-06-09 08:02:20 +00:00
Jessica Lawshe
8c816b3b23 Merge pull request #6509 from overleaf/jel-migrate-sso-id
[v1 and web] Migrate institution SSO external user ID

GitOrigin-RevId: f31cd50fbada9a2704df1c837d695f2ff547420d
2022-06-08 08:03:22 +00:00
Thomas
6f55a99ae1 Merge pull request #6180 from overleaf/tm-history-upgrade-individual-projects
Add script for converting individual projects to FPH and history upgrade helper

GitOrigin-RevId: 4cf075e08045869fe87724fb28949fe91b780e93
2022-05-31 08:04:19 +00:00
Alf Eaton
16f3dc3abc Merge pull request #7829 from overleaf/ab-refresh-features-script-update
[web / script] Handle analytics and dropbox unlinking in refresh_features script

GitOrigin-RevId: 9d0524aeab5dcf810e28c3de4f61ab7f3913f872
2022-05-27 08:03:58 +00:00
Eric Mc Sween
1c0a9dae72 Merge pull request #8033 from overleaf/em-find-files-without-ids
Script to find files and docs without ids in projects

GitOrigin-RevId: 5c29d92748a01a1e48288479b25560127aafd397
2022-05-20 08:03:33 +00:00
Eric Mc Sween
c26a057522 Merge pull request #7932 from overleaf/em-find-bad-filenames
Script for finding bad doc and file names in projects

GitOrigin-RevId: 21035b9ce847d2c2a3183942458e2b30cc6c3fae
2022-05-19 08:03:48 +00:00
dependabot[bot]
2b2e9cfe45 Bump sanitize-html from 1.27.3 to 2.7.0 in /services/web/scripts/translations (#6651)
* [web] scripts/translations: update package-lock to version 2

* Bump sanitize-html in /services/web/scripts/translations

Bumps [sanitize-html](https://github.com/apostrophecms/sanitize-html) from 1.27.3 to 2.7.0.
- [Release notes](https://github.com/apostrophecms/sanitize-html/releases)
- [Changelog](https://github.com/apostrophecms/sanitize-html/blob/main/CHANGELOG.md)
- [Commits](https://github.com/apostrophecms/sanitize-html/commits/2.7.0)

---
updated-dependencies:
- dependency-name: sanitize-html
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

* [web] adapt locales escaping and usage for new sanitize-html version

Co-authored-by: Jakob Ackermann <jakob.ackermann@overleaf.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
GitOrigin-RevId: 5df107a0a4b3d7c408f676ee363169f0ef0de28f
2022-05-18 08:04:19 +00:00
Jakob Ackermann
f0bd6dda23 Merge pull request #7986 from overleaf/jpa-eslint-8
[misc] upgrade eslint packages to the latest version everywhere

GitOrigin-RevId: f1480d4a171acef82fb26c4aa54be3a6088b0ab3
2022-05-17 08:05:59 +00:00
Alexandre Bourdin
eb81b2b6de Merge pull request #7010 from overleaf/ab-mixpanel-backfill-program
[web] Skip backfilling user program membership if not set

GitOrigin-RevId: a8193ee7701cd3229f1eafef23d7d0ed87e9aedc
2022-05-12 10:40:16 +00:00
June Kelly
ebc24c5bf9 Merge pull request #7788 from overleaf/jpa-deletion-retries
[web] add retries to project archiver deletion

GitOrigin-RevId: 90097a057b1ed6224151ddfb7f5c7be4ed4b34c4
2022-04-29 08:03:22 +00:00
Timothée Alby
ed688cce4e Merge pull request #7748 from overleaf/jpa-broad-schema
[misc] handle an old project archiver key schema when deleting projects

GitOrigin-RevId: 2da514c0533127f6d9f9d25cac62102c852ac2a2
2022-04-27 08:04:39 +00:00
Timothée Alby
62075a6ba9 Merge pull request #7735 from overleaf/jpa-fix-hard-deletion
[web] fix result handling from project-archiver hard deletion

GitOrigin-RevId: c6d7746e5e45b05d6372e5efcc029e0b566ace2d
2022-04-26 08:04:25 +00:00
Jakob Ackermann
bc574ef9e9 Merge pull request #7582 from overleaf/jpa-cleanup-project-archiver
[web] add a new script for hard deleting orphaned project archives

GitOrigin-RevId: 1fb49d60cc7c5fa3b8c2d644ac7ed9dbebe5e5d6
2022-04-26 08:03:42 +00:00
Jakob Ackermann
0120268c57 Merge pull request #7579 from overleaf/jpa-refactor-orphaned-data-helper
[web] de-duplicate logic for get a list of hard deleted project ids

GitOrigin-RevId: daf2ff427e24f9ef9253e4bc9ff52f53196fd854
2022-04-26 08:03:38 +00:00
Eric Mc Sween
f561650b62 Merge pull request #7578 from overleaf/em-fix-filetrees
Fix typo in script for bad filetrees

GitOrigin-RevId: 57394e5533f98a890223a0af6f4b389a82e60d84
2022-04-22 08:03:12 +00:00
Jakob Ackermann
f438bdcfed Merge pull request #7504 from overleaf/em-fix-bad-trees
Script for fixing bad file trees

GitOrigin-RevId: 061e306cc1df5774b496efff8e10714fbf1d738d
2022-04-13 08:03:48 +00:00
Eric Mc Sween
8ce9330a00 Merge pull request #7477 from overleaf/em-bad-filetree
Fix bad filetree script

GitOrigin-RevId: 8f9b7d94c717b21b2183d43fdccf4564408f71fa
2022-04-11 08:04:02 +00:00
Jakob Ackermann
b765aa40b0 Merge pull request #7485 from overleaf/jpa-upgrade-package-locks
[misc] upgrade package locks to v2

GitOrigin-RevId: 76df927b674220e17b6dd07f988dd56205673beb
2022-04-11 08:03:52 +00:00
Jakob Ackermann
7fc3c0e28a Merge pull request #6499 from overleaf/dependabot-npm_and_yarn-services-web-scripts-translations-postcss-7.0.39
Bump postcss from 7.0.32 to 7.0.39 in /services/web/scripts/translations

GitOrigin-RevId: 4ef42a483f286c5c346720188609bf3ad76e5370
2022-04-11 08:03:02 +00:00
Eric Mc Sween
ed40ce27ab Merge pull request #7467 from overleaf/em-bad-filetree
Find file trees that have null folder entries

GitOrigin-RevId: aa4c7ed180479288d4ce26549ceeaa0f5ebbd298
2022-04-08 08:05:02 +00:00
Eric Mc Sween
97dca3de1c Merge pull request #7422 from overleaf/em-bad-filetree
Cover more cases in bad filetree script

GitOrigin-RevId: 76aea86f56b16c60d3ed853e486bf00137f0ea5c
2022-04-08 08:04:00 +00:00
Eric Mc Sween
9c036b1d90 Merge pull request #7417 from overleaf/em-find-bad-file-trees
Script for finding malformed filetrees

GitOrigin-RevId: 256f724ec61c0a88a8904f9a4c028cfc78d6d0bb
2022-04-07 08:04:12 +00:00
Henry Oswald
380ba96a8b Merge pull request #7360 from overleaf/ho-purge-sess-improvements
improve the purge sessions script a bit

GitOrigin-RevId: 3b211c1377bc6aa117d3f872a829bb87b16fd9e5
2022-04-05 12:21:58 +00:00
Eric Mc Sween
3235119302 Merge pull request #7228 from overleaf/em-node-16
Upgrade to Node 16

GitOrigin-RevId: 3db1ae57ffb02f8a2b9012ffbb3efecfc01d2b04
2022-04-05 12:20:52 +00:00
Henry Oswald
9b71561814 Merge pull request #7302 from overleaf/ho-session-purge
mvp to purge session keys from redis

GitOrigin-RevId: d1298d4b042164d9c94a7a1d1b7560b6531ae093
2022-04-05 12:19:36 +00:00
Alf Eaton
a079aa1fae Merge pull request #7251 from overleaf/jpa-convert-doc-to-file-script
[web] convert convert-to-file endpoint into a script

GitOrigin-RevId: 5babebae5df8510b83f09ec4a2bb4064cca5ec75
2022-04-05 12:17:00 +00:00
Thomas
1aae979398 Send delete request to chat when expiring deleted projects (#6997)
* Send delete request to chat when expiring deleted projects

* Add script to clean-up orphaned chat of previously expired projects

GitOrigin-RevId: 157d100bd51b6204a9e31733b5164b8e7036ef01
2022-03-28 08:04:29 +00:00
Jakob Ackermann
1bee808551 Merge pull request #7220 from overleaf/jpa-wait-for-db
[web] scripts/undelete_project_to_user: add missing wait for db call

GitOrigin-RevId: 80a767d26ee529c0aabf8ce11a010dca4a51be2b
2022-03-25 09:03:59 +00:00
Jakob Ackermann
d993144fec Merge pull request #7214 from overleaf/jpa-refactor-insecure-endpoint
[web] refactor an insecure web-api endpoint into a script

GitOrigin-RevId: ba565a41d11fdaeb919dbf3cfe80c6f2e2474df1
2022-03-25 09:03:55 +00:00
Brian Gough
a28e0eaab0 Merge pull request #7073 from overleaf/bg-features-epoch
[web] add note to refresh_features.js script

GitOrigin-RevId: 5bda96df8a604c0d5b370aa25b0851486401ed7d
2022-03-17 09:03:30 +00:00
Alexandre Bourdin
5355c7382c Merge pull request #6984 from overleaf/ab-backfill-mixpanel-props
Add script to backfill Mixpanel properties for SSO users

GitOrigin-RevId: da7aef545dd4c66d3916febcc287043cbf455f65
2022-03-08 09:03:36 +00:00
Jakob Ackermann
fa55598c82 Merge pull request #6721 from overleaf/jpa-back-fill-staff-access
[web] scripts: add a new script for back filling staff access for admins

GitOrigin-RevId: c7eaa5887bdbc1a9594553961bd08fba48a451ed
2022-02-16 11:37:40 +00:00
Jakob Ackermann
ae0c347f27 Merge pull request #6542 from overleaf/jpa-em-code-sharing-workspaces
[misc] npm workspaces

GitOrigin-RevId: 87aa72db6637fb238d7cd35b0a48ac3ed58ab3eb
2022-02-16 11:31:07 +00:00
Timothée Alby
22ee7d6da2 Merge pull request #6525 from overleaf/jpa-harden-translations-sanitize
[web] scripts/translations: sanitize: double down on angular xss

GitOrigin-RevId: d08deab392942e593e920e648118f0e196af1740
2022-02-03 09:04:05 +00:00
Timothée Alby
58cf92620a Merge pull request #6523 from overleaf/jpa-translations-check-sanitize
[web] scripts/translations: add script for checking html sanitization

GitOrigin-RevId: d4b9c9a7eb1ed0ca9202b0cb6e4c33f3e73bd0e4
2022-02-03 09:03:58 +00:00
Jakob Ackermann
d90dc2bfae Merge pull request #6519 from overleaf/jpa-lodash-4-17-21
[misc] upgrade lodash from 4.x to 4.17.21

GitOrigin-RevId: 08e03981ffe0f2d3e3d29d9b094d98fcb2d95a6f
2022-02-01 09:03:29 +00:00
Jakob Ackermann
2ed696b3e0 Merge pull request #6517 from overleaf/jpa-node-fetch-2-6-7
[misc] upgrade node-fetch from 2.6.x to 2.6.7

GitOrigin-RevId: 5a43e82e23d78fd6e68a38655dab4665a401a9db
2022-02-01 09:03:24 +00:00
Jakob Ackermann
8789296f5a Merge pull request #6481 from overleaf/jpa-node-14-18-3
[misc] upgrade node version from 14.18.1 to 14.18.3

GitOrigin-RevId: 976542fcc0271e323695c59a987dcf1614ee633e
2022-01-28 09:03:53 +00:00
June Kelly
cc515afe95 Merge pull request #6484 from overleaf/ta-script-require-fix
Fix Require Path

GitOrigin-RevId: 1525890bd24520d8715cfbc8d617c545ef199314
2022-01-28 09:03:32 +00:00
Jakob Ackermann
cfaec97a3d Merge pull request #6393 from overleaf/ta-backfill-user-properties
Backfill User Properties

GitOrigin-RevId: ea2ffeaaf71d5ce41c76a1bfb2f0014006ef0d08
2022-01-26 09:03:06 +00:00
Tim Alby
bbac46156b convert price_in_unit to price_in_cents
GitOrigin-RevId: bae030e9c90f8286d6e6550744849984fe81f63d
2022-01-21 09:03:29 +00:00
Tim Alby
3e70546e18 rename price attributes to price_in_cents or price_in_unit
GitOrigin-RevId: 8045472c96862078583fcb522099ad78926281dc
2022-01-21 09:03:23 +00:00
lawshe
212430e430 Run script on primary
GitOrigin-RevId: 655191d2948ce3a1cfedc4e660965ed90c0371ba
2022-01-14 09:03:23 +00:00
Jessica Lawshe
e8a4a88e87 Merge pull request #6238 from overleaf/jel-script-remove-email
[web] Script to remove email

GitOrigin-RevId: c8f1a69259904b08ef39181b8b7e9c3150ea59f0
2022-01-13 09:04:22 +00:00
Thomas
5e61fce3b4 Enable additional currencies when purchasing (or upgrading to) a group plan (#4884)
* Add script to fetch group data pricing from Recurly

* Update groups pricing data using script to fetch prices from Recurly

* Add additional currencies to saas settings

* Refactor group plans upgrade modal to use shared options from settings

GitOrigin-RevId: 6d13d5b152d01e0399f9d2b8f6f8bf99784589e8
2022-01-12 09:03:21 +00:00
Alf Eaton
50df230846 [web] Upgrade Prettier to match version in monorepo root (#6231)
GitOrigin-RevId: 02f97af1b9704782eee77a0b7dfc477ada23e34d
2022-01-11 09:03:23 +00:00
Brian Gough
e7f040ecf7 Merge pull request #6116 from overleaf/bg-remove-large-broken-docs
[web] allow large broken docs to be deleted

GitOrigin-RevId: 0322f55fcc5448ec1d6e6ee96056b80980bd3406
2021-12-14 09:03:12 +00:00
Thomas
ee08ace46b Merge pull request #6033 from overleaf/bg-add-recover-doc-script
[web] add script to recover dangling docs from redis

GitOrigin-RevId: 2fca3d6b27cb35c6ee6cb1f32588ab7390a63d3f
2021-12-09 09:02:32 +00:00
Thomas
abbacd71b7 Merge pull request #6025 from overleaf/tm-history-upgrade-fix-retry-failed
Fix for None without conversion to correctly retry failed upgrades and speed up mongo queries

GitOrigin-RevId: 22d2b936f478ee8395775ed258095f1bf647c88f
2021-12-09 09:02:29 +00:00
Thomas
cb6fc31225 Merge pull request #6017 from overleaf/tm-history-upgrade-v1-with-conversion
Add script for upgrading v1 projects requiring conversion

GitOrigin-RevId: 4f3cec528a0b9ad56db652d831052caa91e62521
2021-12-08 09:03:09 +00:00
Eric Mc Sween
b22df1dcba Merge pull request #5984 from overleaf/em-unnecessarily-async-functions
Clean up unnecessarily async functions

GitOrigin-RevId: 59f0f0a76b4436f3b99a09b747670d443bac4582
2021-12-07 09:03:33 +00:00
Thomas
be17e022a6 Merge pull request #5975 from overleaf/tm-history-upgrade-count-fails
Fix for counting upgrade failures in history counts script

GitOrigin-RevId: a679fc6e588fc236c31f32e3c27883f25b7f6249
2021-12-06 09:02:58 +00:00
Eric Mc Sween
993a6d0eb9 Merge pull request #5968 from overleaf/em-oversized-docs
Get path from Mongo when fixing oversized docs

GitOrigin-RevId: 07d5425d37faf935c162f57f63f6f1cf4c62d592
2021-12-02 09:03:20 +00:00
Thomas
88dabee6df Add options for controlling hint & retries to history upgrade scripts (#5967)
* Add USE_QUERY_HINT to allow configuring hint usage in history scripts

* Add RETRY_FAILED option to re-attempt previously failed history upgrades

* Add HistoryConversionFailed count to counts script

* Increase default batch size/concurrency on count script

GitOrigin-RevId: a498294719a504b224c04c95363bf098bb80b574
2021-12-02 09:03:10 +00:00
Eric Mc Sween
b9c8627d6a Merge pull request #5957 from overleaf/em-fix-oversized-docs
Add script for fixing oversized docs

GitOrigin-RevId: 513ce326884e00530182d3272a9be1134e1fb1f5
2021-12-01 09:03:16 +00:00
Thomas
40b087fee8 Merge pull request #5952 from overleaf/tm-batched-update-ranges
Add BATCH_RANGE_END(/BATCH_RANGE_START) env vars for batchedUpdate scripts

GitOrigin-RevId: e74f30368194584a6fb398963e0c04f850a8b31d
2021-12-01 09:03:09 +00:00
Eric Mc Sween
76e5d90084 Merge pull request #5915 from overleaf/em-delete-dangling-refs
Add a script for deleting dangling doc and file refs

GitOrigin-RevId: 9de5576e96a6585e72a642324b94744fc605d739
2021-11-26 09:03:33 +00:00
Eric Mc Sween
bcd64d333f Merge pull request #5888 from overleaf/tm-history-upgrade-improve-logging
Prevent unnecessary extra batch, and add a 'continueFrom' helper for BATCH_LAST_ID

GitOrigin-RevId: d6832c40bbed2c27676f4b72d720938707847bfc
2021-11-24 09:03:17 +00:00
Eric Mc Sween
9cf622e013 Merge pull request #5877 from overleaf/tm-history-upgrade-none-with-conversion
Add script for converting and upgrading from SL history to full project history

GitOrigin-RevId: 0e1ad19d3f5cd248ef30e2a0fbb69711cb307b6e
2021-11-24 09:03:13 +00:00
Jakob Ackermann
2261e761f4 Merge pull request #5705 from overleaf/jpa-node-14
[misc] upgrade node version from 12 to 14

GitOrigin-RevId: 15c465c7bb5e42b0c71e2dedb09cf4fe9f1d8ec6
2021-11-19 09:02:56 +00:00
Thomas
302a6fddc8 Merge pull request #5756 from overleaf/tm-history-batched-update-descending
Add BATCH_DESCENDING to reverse processing order of batchedUpdate

GitOrigin-RevId: fb6aff20713dfd8fe6c6a78b64505d96ce4bfb14
2021-11-12 09:02:53 +00:00
Thomas
5c5f42df1f Merge pull request #5752 from overleaf/tm-history-upgrade-failure-checks
Check for upgradeFailed before classifying/upgrading a project as v1

GitOrigin-RevId: 68776665762e87b640aab4c55a5e56062697912a
2021-11-12 09:02:49 +00:00