Difference between revisions of "Parallel"
Jump to navigation
Jump to search
(3 intermediate revisions by the same user not shown) | |||
Line 3: | Line 3: | ||
* Installation: <code>[[brew install parallel]]</code> | * Installation: <code>[[brew install parallel]]</code> | ||
+ | * <code>[[parallel --help]]</code> | ||
== Examples == | == Examples == | ||
[[aws ec2 describe-regions --query]] "Regions[].{Name:RegionName}" --output text | [[parallel]] "echo {}; [[aws ec2 describe-instances]] --region {}" | [[aws ec2 describe-regions --query]] "Regions[].{Name:RegionName}" --output text | [[parallel]] "echo {}; [[aws ec2 describe-instances]] --region {}" | ||
− | |||
your_command | parallel "echo {}; your_command2 {}" | your_command | parallel "echo {}; your_command2 {}" | ||
Line 12: | Line 12: | ||
ls | parallel git -C {} [[git fetch|fetch]] | ls | parallel git -C {} [[git fetch|fetch]] | ||
ls | parallel git -C {} [[git pull|pull]] | ls | parallel git -C {} [[git pull|pull]] | ||
+ | |||
+ | [[parallel -j]] 12 [[--eta]] [[rsync -a]] {} /mnt/efs/myexample ::: mydest/* | ||
== Activities == | == Activities == |
Latest revision as of 08:58, 16 August 2024
parallel
[1] allows the user to execute shell scripts or commands in parallel.
- Installation:
brew install parallel
parallel --help
Examples[edit]
aws ec2 describe-regions --query "Regions[].{Name:RegionName}" --output text | parallel "echo {}; aws ec2 describe-instances --region {}"
your_command | parallel "echo {}; your_command2 {}"
ls | parallel git -C {} fetch ls | parallel git -C {} pull
parallel -j 12 --eta rsync -a {} /mnt/efs/myexample ::: mydest/*
Activities[edit]
Basic[edit]
- Execute a command in parallel by ssh in MACHINE1 and MACHINE2 using parallel
- Read stackexchange questions about gnu-parallel: https://unix.stackexchange.com/questions/tagged/gnu-parallel?tab=votes&pagesize=50
- Install parallel in macOS:
brew install parallel
can conflict withbrew install moreutils
Intermediate[edit]
- Review different parallel options such as:
--keep-order
or-k
which keep order in the output. Do not affect order of execution. - Update all your
git
repositories in a directory in macOS using parallel:ls | parallel git -C {} fetch
Related terms[edit]
- Parallels
for
pssh
parallel --citation
yarn workspaces foreach --paralell
- PostgreSQL parallel query
- Android parallel apps
- Parallel computing
- ansible -B, --background
- parallel --sshlogin
- pigz, gipz parallel implementation
See also[edit]
parallel
,for
,xargs
,parallel --citation, sshlogin
xargs
,parallel
,paste
,map
moreutils
stress, parallel, ab
- CPU, GPU, NPU, TPU, DPU, Groq, Proliant, thread (
Pthreads
), processor, CPU socket, core, ARM , CPU Virtualization, Intel, AMD,nm
,lscpu
, AVX-512, Passthrough, CPU intensive, Graviton processor, Branch predictor, vCPU, SSE, Power
Text is available under the Creative Commons Attribution-ShareAlike License; additional terms may apply. By using this site, you agree to the Terms of Use and Privacy Policy.
Source: https://en.wikiversity.org/wiki/Linux/Basic_commands/parallel
Advertising: