Difference between revisions of "Parallel"
Jump to navigation
Jump to search
| (34 intermediate revisions by 4 users not shown) | |||
| Line 1: | Line 1: | ||
| + | {{lowercase}} | ||
<code>[[wikipedia:GNU_parallel|parallel]]</code><ref>https://www.gnu.org/software/parallel/man.html</ref> allows the user to execute shell scripts or [[commands]] in parallel. | <code>[[wikipedia:GNU_parallel|parallel]]</code><ref>https://www.gnu.org/software/parallel/man.html</ref> allows the user to execute shell scripts or [[commands]] in parallel. | ||
| + | |||
| + | * Installation: <code>[[brew install parallel]]</code> | ||
| + | * <code>[[parallel --help]]</code> | ||
== Examples == | == Examples == | ||
| − | aws ec2 describe-regions --query "Regions[].{Name:RegionName}" --output text | parallel aws ec2 describe-instances --region {} | + | [[aws ec2 describe-regions --query]] "Regions[].{Name:RegionName}" --output text | [[parallel]] "echo {}; [[aws ec2 describe-instances]] --region {}" |
| + | |||
| + | your_command | parallel "echo {}; your_command2 {}" | ||
| + | |||
| + | ls | parallel git -C {} [[git fetch|fetch]] | ||
| + | ls | parallel git -C {} [[git pull|pull]] | ||
| − | + | [[parallel -j]] 12 [[--eta]] [[rsync -a]] {} /mnt/efs/myexample ::: mydest/* | |
| − | |||
== Activities == | == Activities == | ||
| Line 11: | Line 19: | ||
# [[Execute a command in parallel by ssh]] in MACHINE1 and MACHINE2 using parallel | # [[Execute a command in parallel by ssh]] in MACHINE1 and MACHINE2 using parallel | ||
# Read stackexchange questions about gnu-parallel: https://unix.stackexchange.com/questions/tagged/gnu-parallel?tab=votes&pagesize=50 | # Read stackexchange questions about gnu-parallel: https://unix.stackexchange.com/questions/tagged/gnu-parallel?tab=votes&pagesize=50 | ||
| − | # Install parallel in macOS: <code>brew install parallel</code> can conflict with <code>brew install | + | # Install parallel in macOS: <code>[[brew install parallel]]</code> can conflict with <code>[[brew install moreutils]]</code> |
=== Intermediate === | === Intermediate === | ||
| Line 19: | Line 27: | ||
== Related terms == | == Related terms == | ||
* [[Parallels]] | * [[Parallels]] | ||
| − | * [[for]] | + | * <code>[[for]]</code> |
| − | * [[pssh]] | + | * <code>[[pssh]]</code> |
| − | * [[parallel --citation]] | + | * <code>[[parallel --citation]]</code> |
| + | * <code>[[yarn workspaces foreach]] --paralell</code> | ||
| + | * [[PostgreSQL parallel query]] | ||
| + | * [[Android parallel apps]] | ||
| + | * [[Parallel computing]] | ||
| + | * [[ansible -B]], [[--background]] | ||
| + | * [[parallel --sshlogin]] | ||
| + | * [[pigz]], [[gipz]] parallel implementation | ||
== See also == | == See also == | ||
| + | * {{parallel}} | ||
* {{xargs}} | * {{xargs}} | ||
| − | * <code> | + | * <code>{{moreutils}}</code> |
| + | * {{stress}} | ||
* {{CPU}} | * {{CPU}} | ||
Latest revision as of 08:58, 16 August 2024
parallel[1] allows the user to execute shell scripts or commands in parallel.
- Installation:
brew install parallel parallel --help
Examples[edit]
aws ec2 describe-regions --query "Regions[].{Name:RegionName}" --output text | parallel "echo {}; aws ec2 describe-instances --region {}"
your_command | parallel "echo {}; your_command2 {}"
ls | parallel git -C {} fetch
ls | parallel git -C {} pull
parallel -j 12 --eta rsync -a {} /mnt/efs/myexample ::: mydest/*
Activities[edit]
Basic[edit]
- Execute a command in parallel by ssh in MACHINE1 and MACHINE2 using parallel
- Read stackexchange questions about gnu-parallel: https://unix.stackexchange.com/questions/tagged/gnu-parallel?tab=votes&pagesize=50
- Install parallel in macOS:
brew install parallelcan conflict withbrew install moreutils
Intermediate[edit]
- Review different parallel options such as:
--keep-orderor-kwhich keep order in the output. Do not affect order of execution. - Update all your
gitrepositories in a directory in macOS using parallel:ls | parallel git -C {} fetch
Related terms[edit]
- Parallels
forpsshparallel --citationyarn workspaces foreach --paralell- PostgreSQL parallel query
- Android parallel apps
- Parallel computing
- ansible -B, --background
- parallel --sshlogin
- pigz, gipz parallel implementation
See also[edit]
parallel,for,xargs,parallel --citation, sshloginxargs,parallel,paste,mapmoreutilsstress, parallel, ab- CPU, GPU, NPU, TPU, DPU, Groq, Proliant, thread (
Pthreads), processor, CPU socket, core, ARM , CPU Virtualization, Intel, AMD,nm,lscpu, AVX-512, Passthrough, CPU intensive, Graviton processor, Branch predictor, vCPU, SSE, Power
Text is available under the Creative Commons Attribution-ShareAlike License; additional terms may apply. By using this site, you agree to the Terms of Use and Privacy Policy.
Source: https://en.wikiversity.org/wiki/Linux/Basic_commands/parallel
Advertising:
