brozek/website
1
0
Fork 0
mirror of https://github.com/Brandon-Rozek/website.git synced 2025-10-10 06:51:13 +00:00
Code Issues Projects Releases Packages Activity

Added medium syndication metadata

Browse source
This commit is contained in:
Brandon Rozek 2023-02-18 21:37:22 -05:00
parent a51e20fbc7
commit a22bb998cb
14 changed files with 78 additions and 68 deletions
Download patch file Download diff file Expand all files Collapse all files

11
content/blog/parallel-scp.md
View file

@ -1,11 +1,13 @@
---
title: "Parallel SCP with LFTP"
date: 2021-07-25T10:38:43-04:00
date: 2021-07-25 14:38:43
draft: false
tags: []
math: false
medium_enabled: true
medium_post_id: 610d337c8783
tags: []
title: Parallel SCP with LFTP
---
Segmented file transfer allows you to split up a file into multiple chunks and download them in parallel. There is a program written for Linux called LFTP which can accomplish this task and supports FTP, HTTP, SFTP, BitTorrent, among others. The syntax is a little funky, so I wrote a wrapper I call `pget` which allows for segmented file transfers using SCP.
Usage:
@ -58,5 +60,4 @@ fi
LFTP_COMMAND="pget -n $NUM_SEGMENTS $FILE_LOCATION;bye"
lftp -e "$LFTP_COMMAND" sftp://"$REMOTE_HOST"
```
```