5 * Bug fixes and man page updates.
7 News about GNU Parallel:
9 * Introduction to parallel computing https://youtu.be/fvrHXV8yqU4?t=2874
11 * Script for summarizing GNU parallel joblog file https://github.com/gavinmdouglas/parallel_joblog_summary
13 * How to copy a single file to multiple directories in Linux or Unix https://www.cyberciti.biz/faq/linux-unix-copy-a-file-to-multiple-directories-using-cp-command/
15 * Search in your Jupyter notebooks from the CLI, fast. https://dev.to/attilavm/search-in-your-jupyter-notebooks-from-the-cli-fast-1408
17 * Parallel Job Orchestration with GNU Parallel https://www.youtube.com/watch?v=2tVpUfND3LI
19 * Optional Individual Submission 4 Job Handling 20266001 - GNU Parallel https://www.youtube.com/watch?v=eC_RPuFCcU8
21 * DOE Cross-facility Workflows Training - April 12, 2023 https://www.youtube.com/watch?v=Ke3sirM-aQQ
23 * How to run MiXCR 4.x on multiple patient samples using GNU Parallel https://www.youtube.com/watch?v=OXg-WHlB_dk
30 * --jobs evaluates expression: +3*log(55)% = ncpu*1.12
32 * Bug fixes and man page updates.
34 News about GNU Parallel:
36 * Running shell script in parallel
37 https://w3toppers.com/running-shell-script-in-parallel/
39 * Simulating climate risk scenarios for the Amazon Rainforest
40 https://aws.amazon.com/blogs/hpc/simulating-climate-risk-scenarios-for-the-amazon-rainforest/
42 * How To Use Your Entire CPU In Bash With Parallel
43 https://bash-prompt.net/guides/parallell-bash/
45 * Bash - parallel command execution
46 https://medium.com/linuxstories/bash-parallel-command-execution-d4bd7c7cc1d6
48 * 3 tips for faster batch post-pro
49 https://www.cfdengine.com/newsletter/142/
56 * Better support for wide characters in --latest-line.
58 * Support for rsync 3.2.7.
60 * Bug fixes and man page updates.
67 * parsort: --parallel now does closer to what you expect.
69 * parallel: --files0 is --files but \0 separated.
71 * Bug fixes and man page updates.
73 News about GNU Parallel:
75 * 5 great Perl scripts to keep in your sysadmin toolbox
76 https://www.redhat.com/sysadmin/perl-scripts
83 * Bug fixes and man page updates.
85 News about GNU Parallel:
87 * The Best Ethical Hacking Tools of 2023 (and their basic usage)
88 https://www.purevpn.com/blog/the-best-hacking-tools-of-2023/#11_GNU_Parallel
90 * GNU Parallel: criando atividades em paralelo com shell script
91 https://www.vivaolinux.com.br/artigo/GNU-Parallel-criando-atividades-em-paralelo-com-shell-script/
98 * --results works on more file systems (e.g. fat)
100 * Joblog gives the same exit code as bash.
102 News about GNU Parallel:
104 * Programação Shell Linux: Paralelismo de processos com GNU parallel
105 https://www.youtube.com/watch?v=duheTWLIrp8
107 * Talk Python: Data Science from the Command Line
108 https://talkpython.fm/episodes/show/392/data-science-from-the-command-line
115 * Support for IPv6 adresses and _ in hostnames in --sshlogin.
117 * Use --total-jobs for --eta/--bar if generating jobs is slow.
119 * A lot of bugs fixed in --latest-line.
121 * Better support for MSYS2.
123 * Better Text::CSV error messages.
125 * --bar supports UTF8.
127 * Bug fixes and man page updates.
129 News about GNU Parallel:
131 * GNU Parallel is now on Mastodon: @GNU_Parallel@hostux.social
138 * --latest-line chops line length at terminal width.
140 * Determine max command length faster on Microsoft Windows.
142 News about GNU Parallel:
144 * Distributed Task Processing with GNU Parallel
145 https://www.youtube.com/watch?v=usbMLggdMgc
147 * GNU Parallel workflow for many small, independent runs
148 https://docs.csc.fi/support/tutorials/many/
150 * Copy a File To Multiple Directories With A Single Command on Linux
151 https://www.linuxfordevices.com/tutorials/linux/copy-file-to-multiple-directories-with-one-command
153 * Behind The Scenes: The Power Of Simple Command Line Tools At Cloud
155 https://blog.gdeltproject.org/behind-the-scenes-the-power-of-simple-command-line-tools-at-cloud-scale/
157 * Run lz4 compression in parallel using GNU parallel
158 https://www.openguru.com/2022/09/
160 * Xargs / Parallel With Code Examples
161 https://www.folkstalk.com/2022/09/xargs-parallel-with-code-examples.html
163 * Parallel processing on a single node with GNU Parallel
164 https://www3.cs.stonybrook.edu/~cse416/Section01/Slides/SeaWulfIntro_CSE416_09222022.pdf
166 * Using GNU parallel painlessly -- from basics to bioinformatics job
167 orchestration https://www.youtube.com/watch?v=qypUdm-IE9c
174 * --colour-failed only changes output for failing jobs.
176 * Password for --sshlogin can be put in $SSHPASS.
178 * Examples are moved from `man parallel` to `man parallel_examples`.
180 * Bug fixes and man page updates.
182 News about GNU Parallel:
184 * WOMM - Works On My Machine uses GNU Parallel https://pypi.org/project/womm/
191 * --header 0 allows using {filename} as replacement string
193 * Bug fixes and man page updates.
200 * --colour-failed will color output red if the job fails.
202 * sql: support for InfluxDB.
204 * Polarhome.com is dead, so these OSs are no longer supported: AIX
205 HPUX IRIX Minix OPENSTEP OpenIndiana OpenServer QNX Solaris Syllable
206 Tru64 Ultrix UnixWare.
208 * Bug fixes and man page updates.
215 * , can be used in --sshlogin if quoted as \, or ,,
217 * --plus {/#regexp/str} replace ^regexp with str.
219 * --plus {/%regexp/str} replace regexp$ with str.
221 * --plus {//regexp/str} replace every regexp with str.
223 * 'make install' installs bash+zsh completion files.
225 * Bug fixes and man page updates.
232 * --latest-line shows only the latest line of running jobs.
234 * --color colors output in different colors per job (this obsoletes --ctag).
236 * xargs compatibility: --process-slot-var foo sets $foo to jobslot-1.
238 * xargs compatibility: --open-tty opens the terminal on stdin (standard input).
240 * Bug fixes and man page updates.
242 News about GNU Parallel:
244 * Building a fault-tolerant work queue for command-line executions
245 with GNU Parallel https://www.jvt.me/posts/2022/04/28/shell-queue/
247 * Make your code do more, with less
248 https://www.blopig.com/blog/2022/05/make-your-code-do-more-with-less/
250 * W09 B IntroHPC II 20220513 gnu parallel
251 https://www.youtube.com/watch?v=2udvC90rIa4
258 * sash is no longer supported as shell.
260 * --retries 0 is an alias for --retries 2147483647.
262 * --shell-completion returns shell completion code.
264 * --ssh-login-file reloads every second.
266 * --parset is replaced with --_parset because it is only used internally.
268 * sem --pipe passes STDIN (standard input) to the command.
270 * Bug fixes and man page updates.
277 * --sshlogin user:password@host is now supported by using sshpass.
279 * Bug fixes and man page updates.
281 News about GNU Parallel:
283 * Bash: GNU Parallel with Curl
284 https://gist.github.com/CMCDragonkai/5914e02df62137e47f32?permalink_comment_id=2617456
286 * The Pipe Operator Explained
287 https://medium.com/geekculture/the-pipe-operator-explained-cbd41e23775a
294 * Encoding of remote commands has changed. This limits the length of
295 remote commands to less than half. It also requires $REMOTE_TMPDIR
296 to be writable. It makes this release beta quality.
298 * Time functions hh_mm_ss() hhmmss() hh_mm() hhmm() are now available
301 * Many options in the man page for parallel now has 'see also' for
304 * parallel_options_map.pdf is a map showing which options other
307 * {uniq} added to --plus to only run jobs with unique values.
309 * sem --fg exits with the exit code of the job.
311 * Bug fixes and man page updates.
318 * GNU Parallel turned 20 on the 2022-01-06
319 https://www.gnu.org/software/parallel/20th-birthday.html
321 * Bug fixes and man page updates.
323 News about GNU Parallel:
325 * Save Time with Modern Search Techniques
326 https://www.eventbrite.com/e/ohio-information-security-forum-january-2022-monthly-meeting-tickets-240632737997
328 * Bash "Fail immediately if any fails"
329 https://morioh.com/p/a01b883dc57c
331 * Re-encoding the EmacsConf videos with FFmpeg and GNU Parallel
332 https://sachachua.com/blog/2021/12/re-encoding-the-emacsconf-videos-with-ffmpeg-and-gnu-parallel/
334 * Bash 平行 https://learntutorials.net/ja/bash/topic/10778/%E5%B9%B3%E8%A1%8C
341 * Bug fixes and man page updates.
343 News about GNU Parallel:
345 * The first version of Parallel will be 20 years on 2022-01-06
347 * HerrComp Intro HPC gnu parallel
348 https://www.youtube.com/watch?v=tcgjKWfgWQY
351 https://qiita.com/toramili/items/44a770cfb9ef1edc9e26
353 * How To Install parallel on Ubuntu 20.04
354 https://installati.one/ubuntu/20.04/parallel/
356 * Distributing embarrassingly parallel tasks GNU Parallel
357 https://ulhpc-tutorials.readthedocs.io/en/latest/sequential/gnu-parallel/
364 * Bug fixes and man page updates.
366 News about GNU Parallel:
368 * Otimizando o seu Hacking com o GNU Parallel - Mateus Buogo
369 https://www.youtube.com/watch?v=xIpPPZXDKGU
371 * SMACK 12 - Do it faster! Simple ways to use all those cores (and
372 GPUs) efficiently. https://www.youtube.com/watch?v=lXDGY7NvOYk
379 * Don't postpone output until $jobslots jobs have been started.
381 * Bug fixes and man page updates.
383 News about GNU Parallel:
385 * How to Install GNU Parallel using Anaconda | Linux
386 https://www.youtube.com/watch?v=UwDNVP-L0qA
388 * Install GNU Parallel from source code | Linux
389 https://www.youtube.com/watch?v=PIyJH4ben5o
391 * Compiling GNU Parallel on CentOS-7
392 https://thelinuxcluster.com/2021/10/19/compiling-gnu-parallel-on-centos-7/
399 * Bug fixes and man page updates.
401 News about GNU Parallel:
403 * 3 Programs that will Level Up your Bash Game
404 https://medium.com/codex/3-programs-that-will-level-up-your-bash-game-bf14e17e2291
406 * I Summarized 100+ Command-Line Tools for Data Scientists in 15
408 https://towardsdatascience.com/i-summarized-100-command-line-tools-for-data-scientists-in-15-minutes-976def544ffe
410 * Speed up Your Builds by Parallelizing
411 https://www.incredibuild.com/blog/speed-up-your-builds-by-parallelizing
413 * Bash: GNU Parallel with Curl
414 https://gist.github.com/dinh/93b936a55de9a331199d6582bc2921d2
421 * --ctag/--ctagstring colors the tag in different colors for each job.
423 * You can use unit prefixes (k, m, g, etc) with -n -N -L.
425 * Bug fixes and man page updates.
427 News about GNU Parallel:
429 * Parallelising jobs with GNU parallel
430 https://blog.ronin.cloud/gnu-parallel/
432 * Use multiple CPU Cores with your Linux commands - awk, sed, bzip2,
433 grep, wc, etc. https://cdmana.com/2021/07/20210728132344693t.html
435 * How to execute commands in parallel in Linux
436 https://net2.com/how-to-execute-commands-in-parallel-in-linux/
443 * --results no longer prints the result to standard output (stdout) as
445 https://lists.gnu.org/archive/html/parallel/2020-12/msg00003.html
447 * parset supports associative arrays in bash, ksh, zsh.
449 * Online HTML is now generated by Sphinx.
451 * Bug fixes and man page updates.
453 News about GNU Parallel:
455 * Cleaning Up Scanned Documents with Open Source Tools
456 https://kaerumy.medium.com/cleaning-up-scanned-documents-with-open-source-tools-9d87e15305b
463 * Bug fixes and man page updates.
465 News about GNU Parallel:
467 * How to use GNU Parallel
468 https://techtipbits.com/linux/how-to-use-gnu-parallel/
470 * How to Speed Up Bash Scripts with Multithreading and GNU Parallel
471 https://adamtheautomator.com/how-to-speed-up-bash-scripts-with-multithreading-and-gnu-parallel/
473 * Use Parallel to split by line
474 https://madflex.de/use-parallel-to-split-by-line/
476 * Optimizing long batch processes or ETL by using buff/cache properly
477 II (parallelizing network operations)
478 http://www.elsotanillo.net/2021/06/optimizing-long-batch-processes-or-etl-by-using-buff-cache-properly-ii-parallelizing-network-operations/
480 * Parallelization 3: GNU Parallel https://www.youtube.com/watch?v=Rl06WD60afA
487 * --plus includes {%%regexp} and {##regexp}.
489 * Bug fixes and man page updates.
491 News about GNU Parallel:
493 * Batch Calculate and Verify MD5 Checksum With GNU Parallel
494 https://omicx.cc/posts/2021-04-28-calculate-and-verify-md5-checksum-with-gnu-parallel/
496 * HerrComp Gnu parallel, c++11 threads 2021 04 28
497 https://www.youtube.com/watch?v=wDd9F9nn0qA
499 * Distributing embarrassingly parallel tasks GNU Parallel
500 https://ulhpc-tutorials.readthedocs.io/en/latest/sequential/gnu-parallel/
502 * Job Parallelization on Niagara
503 https://www.maryamdaryalal.com/post/job-parallelization-on-niagara
505 * Use Parallel to split by line
506 https://madflex.de/use-parallel-to-split-by-line/
508 * m1 multi-core batch convert with gpu parallel + ffmpeg
509 https://www.youtube.com/watch?v=hAuc0YsXv6A
516 * Bug fixes and man page updates.
518 News about GNU Parallel:
520 * Bioinformatics tutorials - linux and shell advanced - parallel
521 https://www.youtube.com/watch?v=5leL8pyl0XA
523 * GNU Parallel for quick gains
524 https://edbennett.github.io/high-performance-python/04-gnu-parallel/index.html
526 * Processing Linux Commands in Parallel
527 https://www.baeldung.com/linux/processing-commands-in-parallel
530 https://docs-research-it.berkeley.edu/services/high-performance-computing/user-guide/running-your-jobs/gnu-parallel/
532 * GNU Parallel 활용 가이드https://genoglobe.com/kribb/gnu_parallel
534 * Parallel Grep and Awk
535 https://www.highonscience.com/blog/2021/03/21/parallel-grep/
537 * Getting things done with shell scripting
538 https://doma.dev/blog/get-things-done-with-bash/
543 * Bug fixes and man page updates.
545 News about GNU Parallel:
547 * The very first version of Parallel dated 2002-01-06 was found in an
558 (".PHONY : job$jobnr\n",
562 unshift @makefile, "all : ",(map { "job$_ " } 1 .. $jobnr),"\n";
564 open (MAKE, "| make -k -f - -j $processes") || die;
565 print MAKE @makefile;
568 * Introduction to GNU Parallel
569 https://www.youtube.com/watch?v=Kj-6JkAqw-8
571 * Using GNU Parallel with GooseSLURM
572 https://readthedocs.org/projects/gooseslurm/downloads/pdf/latest/#chapter.7
575 https://github.com/lijingbu/omics/blob/main/why_gnu_parallel.md
580 * --filter only run jobs where the filter is true. The filter can
581 contain replacement strings and Perl code such as: '{1} < {2}+1'
583 * --template takes a text file as a template with replacement
584 strings. Then it replaces the replacement strings and saves it
585 under a new filename.
587 * --plus implements {0%} {0#} replacement string for zero padded slot
590 * Warn that you probably mean -d '\r\n' if the first 3 values end in
593 * {= perlexpression =} must return the same value, if run twice on the
596 * Man pages available as .rst-format.
598 * Bug fixes and man page updates.
600 News about GNU Parallel:
602 * A short tutorial on Gnu Parallel
603 https://www.polarmicrobes.org/a-short-tutorial-on-gnu-parallel/
605 * 5 reasons why I love coding on Linux
606 https://opensource.com/article/21/2/linux-programming
608 * Simple Tutorial to install & use GNU Parallel
609 https://medium.com/analytics-vidhya/simple-tutorial-to-install-use-gnu-parallel-79251120d618
611 * LiDO3 - first contact
612 https://www.lido.tu-dortmund.de/cms/de/LiDO3/LiDO3_first_contact_handout.pdf
614 * Rill Stage 2-1: Ways of command-line data analysis
615 https://blog.jastix.biz/post/rill-stage-2-1-cli-data-analysis/
617 * Introduction to GNU Parallel
618 https://blog.knoldus.com/introduction-to-gnu-parallel/
620 * GNU Parallel https://www.hahwul.com/cullinan/parallel/
625 * --memsuspend suspends jobs when there is little memory free. This
626 way you can run jobs in parallel that added up potentially will take
627 up more RAM than is available.
629 * $PARALLEL_ARGHOSTGROUPS and the replacement string {agrp} will give
630 the hostgroup given on the argument when using --hostgroup.
632 * Handy time functions for {= =}: yyyy_mm_dd_hh_mm_ss()
633 yyyy_mm_dd_hh_mm() yyyy_mm_dd() yyyymmddhhmmss() yyyymmddhhmm()
634 yyyymmdd() hash($str)
636 * Bug fixes and man page updates.
638 News about GNU Parallel:
640 * Software Engineering For Scientists
641 https://canvas.stanford.edu/courses/133091
643 * Optional Individual Submission 4 Job Handling - GNU Parallel
644 https://www.youtube.com/watch?v=-tX0bFAYAxM
646 * 关于gnu parallel:GnuParallel:在集群上并行化脚本,脚本将文件写入主
647 节点https://www.codenong.com/25172209/
650 https://qiita.com/hana_shin/items/53c3c78525c9c758ae7c
655 * --pipe engine changed making --pipe alpha quality.
657 * --results -.json outputs results as JSON objects on stdout (standard
660 * --delay 123auto will auto-adjust --delay. If jobs fail due to being
661 spawned too quickly, --delay will exponentially increase.
663 * --plus sets {hgrp} that gives the intersection of the hostgroups of
664 the job and the sshlogin that the job is run on.
666 * Bug fixes and man page updates.
668 News about GNU Parallel:
670 * Best practices for accelerating data migrations using AWS Snowball
672 https://aws.amazon.com/blogs/storage/best-practices-for-accelerating-data-migrations-using-aws-snowball-edge/
674 * Pass the Output of a Command as an Argument for Another
675 https://www.baeldung.com/linux/pass-cmd-output-as-an-argument
677 * Warwick RSE Drop-in - Workflow Management Part 2 - GNU Parallel
678 https://www.youtube.com/watch?v=t_v2Otgt87g
683 * Bug fixes and man page updates.
685 News about GNU Parallel:
687 * https://bash-prompt.net/guides/gnu-parallel-multi-server/
692 * --termseq now works for jobs running remotely.
694 * parsort: Performance optimized for 64-core machines.
696 * Bug fixes and man page updates.
698 News about GNU Parallel:
700 * Juan Sierra Pons has made a testimonial:
701 http://www.elsotanillo.net/wp-content/uploads/GnuParallel_JuanSierraPons.mp4
703 * 「翻译」在生物信息学中使用 GNU-Parallel
704 https://cloud.tencent.com/developer/article/1705499
709 * New CPU detection for GNU/Linux.
711 * Bug fixes and man page updates.
713 News about GNU Parallel:
715 * Aug 21, 2020 - More Unix tools
716 https://floki.blog/2020/08/more_unix_tools
723 * Max command line length is changed for MacOS - making this version
724 beta quality for MacOS.
726 * Bug fixes and man page updates.
733 * No new functionality
735 * Bug fixes and man page updates.
737 News about GNU Parallel:
739 * Tips for Running Jobs on your VM
740 https://support.ehelp.edu.au/support/solutions/articles/6000089713-tips-for-running-jobs-on-your-vm#parallel
742 * Introduction to GNU Parallel: Parallelizing Massive Individual Tasks
743 https://www.youtube.com/watch?v=QSFLTEyCKvo
746 http://www.hpc.lsu.edu/training/weekly-materials/2020-Spring/GNUParallel_Spring_2020.pdf
748 * Linux-Fu: Parallel Universe
749 https://hackaday.com/2020/06/29/linux-fu-parallel-universe/
751 * Resumable batch jobs with gnu parallel https://igor.io/parallel/
753 * Introducing Parallel into Shell
754 https://www.petelawson.com/post/parallel-in-shell/
756 * AV1 encoding parallelization with GNU Parallel
757 https://www.reddit.com/r/AV1/comments/fjvqp9/av1_encoding_parallelization_with_gnu_parallel/
759 * Beschleunigte Befehlsbearbeitung mit GNU Parallel
760 https://www.linux-community.de/ausgaben/linuxuser/2013/06/beschleunigte-befehlsbearbeitung-mit-gnu-parallel/
767 * No new functionality
769 * Bug fixes and man page updates.
771 News about GNU Parallel:
773 * GNU Parallel is used at NERSC:
774 https://www.nersc.gov/assets/Uploads/08-Workflows-20200616.pdf
776 * Resumable batch jobs with GNU Parallel https://igor.io/parallel/
778 * Lab Meeting technical talk
779 https://www.slideshare.net/hoffmanlab/gnu-parallel-194030490
781 * Open Sky Software Website Credits
782 https://www.openskysoftware.com/site-credits.htm
784 * Speed up your Python Scripts using Ubuntu and GNU Parallel
785 https://ecce.esri.ca/wpecce/2019/12/24/speed-up-your-python-scripts-using-ubuntu-and-gnu-parallel/
787 * Indispensable command-line tools
788 https://negfeedback.blogspot.com/2020/05/indispensable-command-line-tools.html
790 * GNU Parallel for simulations
791 http://pdebuyl.be/blog/2020/gnu-parallel-for-simulations.html
793 * Introduction to GNU parallel
794 https://bioinformaticsworkbook.org/Appendix/GNUparallel/GNU_parallel_examples.html
801 * While running a job $PARALLEL_JOBSLOT is the jobslot of the job. It
802 is equal to {%} unless the job is being retried. See {%} for
805 * While running a job $PARALLEL_SSHLOGIN is the sshlogin line with
806 number of cores removed. E.g. '4//usr/bin/specialssh user@host'
807 becomes: '/usr/bin/specialssh user@host'
809 * While running a job $PARALLEL_SSHHOST is the host part of an
810 sshlogin line. E.g. '4//usr/bin/specialssh user@host' becomes:
813 * --plus activates the replacement strings {slot} = $PARALLEL_JOBSLOT,
814 {sshlogin} = $PARALLEL_SSHLOGIN, {host} = $PARALLEL_SSHHOST
816 * Bug fixes and man page updates.
818 News about GNU Parallel:
820 * Portable Batch System (PBS) & GNU Parallel - Running a Program
821 Multiple Times in Parallel
822 https://www.youtube.com/watch?v=6ccbWu6Befo
824 * GNU Parallel przykład https://www.youtube.com/watch?v=gs_wG4Kt2G4
826 * Demo of LINUX APP - GNU PARALLEL - running multiple Gstreamer webcam
827 .sh scripts with only 1 command
828 https://www.youtube.com/watch?v=trQuA_wmWjg
833 This release celebrates GNU Parallel's 10 years as a GNU tool:
835 > commit ed2dfb1043768154d4e7678e01e10287155fa834
836 > Author: Ole Tange <ole@tange.dk>
837 > Date: Thu Apr 22 01:23:00 2010 +0200
839 > Name change: Parallel is now GNU Parallel.
840 > Basic structure for sshlogin and sshloginfile.
844 * parsort makes GNU sort run faster for files with more than 1M lines.
846 * Bug fixes and man page updates.
848 News about GNU Parallel:
850 * Several clusters have updated their documentation of GNU Parallel:
851 https://www.grid5000.fr/w/GNU_Parallel
852 https://research-it.berkeley.edu/virtual-training-running-jobs-parallel-savio
853 http://www.hpc.lsu.edu/training/archive/tutorials.php
855 * add_pho uses GNU Parallel: https://github.com/SeedlingsBabylab/add_pho
857 * GNU parallel使用笔记https://zhuanlan.zhihu.com/p/37340011
859 * Virtual Workshop: Running Jobs in Parallel on Savio
860 https://ais.berkeley.edu/events/virtual-workshop-running-jobs-parallel-savio/2020-04-20
862 * Free Concurrency with GNU Parallel
863 https://phili.pe/posts/free-concurrency-with-gnu-parallel/
868 * Bug fixes and man page updates.
870 News about GNU Parallel:
872 * The GNU Parallel course in Copenhagen is cancelled
873 https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-med-ole-tange/
875 * The GNU Parallel course in Århus is cancelled
876 https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-og-parallelisering-i-unix-shellen/
878 * The 10 year anniversary may be cancelled, see
879 https://www.gnu.org/software/parallel/10-years-anniversary.html
881 * Running shell commands in parallel, via GNU Parallel
882 https://dev.to/saveriomiroddi/running-shell-commands-in-parallel-via-gnu-parallel-3a72
884 * Faster nmap scanning with the help of GNU parallel
885 https://badshah.io/experiment/faster-nmap-scanning-with-the-help-of-gnu-parallel/
890 * Bug fixes and man page updates.
895 * --blocktimeout dur - Time out for reading block when using
896 --pipe. If it takes longer than dur to read a full block, use the
897 partial block read so far.
899 * Bug fixes and man page updates.
901 News about GNU Parallel:
903 * GNU Parallel course in Copenhagen
904 https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-med-ole-tange/
906 * GNU Parallel course in Århus
907 https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-og-parallelisering-i-unix-shellen/
909 * GNU Parallel pour accélérer vos process sous Linux
910 https://www.yvonh.com/gnu-parallel-pour-accelerer-vos-process-sous-linux/
912 * How to copy a file to multiple directories in Linux
913 https://net2.com/how-to-copy-a-file-to-multiple-directories-in-linux/
915 * Running linux commands in parallel https://dev.to/voyeg3r/runing-linux-commands-in-parallel-4ff8
920 * GNU Parallel course in Copenhagen
921 https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-med-ole-tange/
923 * GNU Parallel course in Århus
924 https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-og-parallelisering-i-unix-shellen/
926 * GNU Parallel is used in
927 https://github.com/JeffersonLab/rfw_tsf_extractor
929 * Bug fixes and man page updates.
934 * GNU Parallel was presented at Driving IT. Slides:
935 cloud.prosa.dk/s/drivingit
937 * Restarting supervisord processes in parallel
938 https://blog.naderman.de/2019/11/14/restarting-supervisord-processes-in-parallel/
940 * Using GNU Parallel to Create Archives Faster
941 https://www.reddit.com/r/DataHoarder/comments/dsgmhc/parallel_archiving_techniques/
943 * Bug fixes and man page updates.
948 * --tee will use --output-error=warn-nopipe if supported by tee.
950 * GNU Parallel will be presented at Driving IT 2019:
951 https://ida.dk/arrangementer-og-kurser/konferencer/driving-it/tools
953 * UMN Duluth: Job parallelization with task arrays and GNU parallel
954 https://www.msi.umn.edu/tutorials/umn-duluth-job-parallelization-task-arrays-and-gnu-parallel
956 * Genome updater uses GNU Parallel
957 https://github.com/pirovc/genome_updater
959 * Using GNU-Parallel for bioinformatics
960 https://www.danielecook.com/using-gnu-parallel-for-bioinformatics/
962 * Speeding up PostgreSQL ETL pipeline with the help of GODS
963 https://cfengine.com/company/blog-detail/speeding-up-postgresql-etl-pipeline-with-the-help-of-gods/
965 * Runing linux commands in parallel
966 https://dev.to/voyeg3r/runing-linux-commands-in-parallel-4ff8
968 * Research Computing University of Colorado Boulder contains an intro
970 https://readthedocs.org/projects/curc/downloads/pdf/latest/
972 * 如何使用Parallel在Shell中并行执行命令
973 https://www.myfreax.com/gnu-parallel/
975 * 如何测试 Amazon Elastic File System
976 https://aws.amazon.com/cn/blogs/china/how-to-test-drive-amazon-elastic-file-system/
978 * Bug fixes and man page updates.
983 * --nice is now inherited by the nice level that GNU Parallel is
984 started at. So 'nice -n10 parallel' will also cause remote jobs to
985 be run at nice level 10.
987 * --delay is now accurate to within 10 ms
989 * GNU Parallel will be presented at Driving IT 2019:
990 https://ida.dk/arrangementer-og-kurser/konferencer/driving-it/tools
992 * Greenland Ice Sheet solid ice discharge from 1986 through 2017
993 https://www.earth-syst-sci-data.net/11/769/2019/essd-11-769-2019.pdf
995 * App Center Cloud Build Machines > Installed Software > Utilities
996 https://docs.microsoft.com/en-us/appcenter/build/software
998 * Curryfinger - SNI & Host header spoofing utility
999 https://dualuse.io/blog/curryfinger/
1002 https://wiki.cac.washington.edu/display/hyakusers/Hyak+parallel-sql
1004 * A meditation on analysing data with Perl in parallel using GNU Parallel
1005 https://www.reddit.com/r/perl/comments/cyo2qc/a_meditation_on_analysing_data_with_perl_in/
1007 * Accélérer ses tâches avec GNU Parallel et les lots de tâches (UL)
1008 https://www.eventbrite.ca/e/inscription-accelerer-ses-taches-avec-gnu-parallel-et-les-lots-de-taches-ul-71412840729
1010 * RMACC Summit GNU Parallel
1011 https://curc.readthedocs.io/en/latest/software/GNUParallel.html
1013 * Introducing Parallel into Shell
1014 https://petelawson.com/post/parallel-in-shell/
1016 * Linux Productivity Tools
1017 https://www.usenix.org/conference/lisa19/presentation/maheshwari
1019 * Gnu/parallel + Nfs 实现共享文件网络的并发计算等操作
1020 http://atomicer.cn/2018/01/18/gnu-parallel-nfs-%E5%AE%9E%E7%8E%B0%E5%85%B1%E4%BA%AB%E6%96%87%E4%BB%B6%E7%BD%91%E7%BB%9C%E7%9A%84%E5%B9%B6%E5%8F%91%E8%AE%A1%E7%AE%97%E7%AD%89%E6%93%8D%E4%BD%9C/#more
1022 * Bug fixes and man page updates.
1027 * GNU Parallel will be presented at Driving IT 2019:
1028 https://ida.dk/arrangementer-og-kurser/konferencer/driving-it#beskrivelse
1030 * Linux Productivity Tools
1031 https://www.usenix.org/conference/lisa19/presentation/maheshwari
1033 * Improve your reconnaissance performance by using GNU Parallel
1034 https://mailchi.mp/3f46ceb46357/improve-your-reconnaissance-performance-by-using-gnu-parallel
1036 * Paralel İşler / İşlemler / Programlar Bash’de Nasıl Çalıştırılır?
1037 https://kaleinfo.com/2019/07/29/paralel-isler-islemler-programlar-bashde-nasil-calistirilir-2/
1039 * Use POLYBAR to change WALLPAPER with GNU Parallel
1040 https://www.youtube.com/watch?v=rjYg-b_eiRU
1042 * Finding the Balance Between Speed & Accuracy During an Internet-wide
1044 https://captmeelo.com/pentest/2019/07/29/port-scanning.html
1046 * GNU Parallel Ryugu released
1047 https://linuxreviews.org/GNU_Parallel_Ryugu_released
1049 * CO2017 - CW1 - Operating Systems & Networks - Shell scripting
1050 http://www.7daixie.com/2019071646302396.html
1052 * Bug fixes and man page updates.
1057 * {= uq; =} causes the replacement string to be unquoted. Example:
1058 parallel echo '{=uq;=}.jpg' ::: '*'
1060 * --tagstring {=...=} is now evaluated for each line with --linebuffer.
1062 * Use -J ./profile to read a profile in current dir.
1064 * Speedup of startup by 40%: Find the parent shell differently on
1065 GNU/Linux, cache information about the CPU and which setpgrp method
1066 to use to make GNU Parallel start 40% faster.
1068 * $PARALLEL_SSHLOGIN can be used in the command line.
1070 * Occasionally sane: Simple usage of GNU parallel
1071 https://vfoley.xyz/parallel/
1073 * How to run multiple bash scripts in parallel
1074 https://techieroop.com/how-to-run-multiple-bash-scripts-in-parallel/
1076 * Announcing Oracle Solaris 11.4 SRU10
1077 https://blogs.oracle.com/solaris/announcing-oracle-solaris-114-sru10
1079 * Руководство по использованию GNU Parallel https://zalinux.ru/?p=2623
1081 * Bug fixes and man page updates.
1086 * --shard can now take a column name and optionally a perl
1087 expression. Similar to --group-by and replacement strings.
1089 * Using AWK and R to parse 25tb
1090 https://livefreeordichotomize.com/2019/06/04/using_awk_and_r_to_parse_25tb/
1092 * Parallel and Visual testing with Behat
1093 http://parallelandvisualtestingwithbehat.blogspot.com/p/blog-page.html
1095 * 维基百科,自由的百科全书https://zh.wikipedia.org/wiki/GNU_parallel
1097 * Bug fixes and man page updates.
1102 * --group-by groups lines depending on value of a column. The value
1105 * How to compress (bzip / gzip) a very large text quickly?
1106 https://medium.com/@gchandra/how-to-compress-bzip-gzip-a-very-large-text-quickly-27c11f4c6681
1108 * Simple tutorial to install & use GNU Parallel
1109 https://medium.com/@gchandra/simple-tutorial-to-install-use-gnu-parallel-79251120d618
1111 * Introducing Parallel into Shell
1112 https://petelawson.com/post/parallel-in-shell/
1114 * Bug fixes and man page updates.
1119 * Invitation to the 10 years anniversary next year.
1121 * Bug fixes and man page updates.
1126 * SIGTERM is changed to SIGHUP, so sending SIGHUP will make GNU
1127 Parallel start no more jobs, but wait for running jobs to finish.
1129 * SIGTERM SIGTERM is changed to SIGTERM, so sending SIGTERM will make
1130 GNU Parallel kill all running jobs.
1132 * GNU Parallel now includes a cheat sheet: parallel_cheat.pdf
1134 * High Throughput Computing on RMACC Summit and Beyond
1135 https://calendar.colorado.edu/event/high_throughput_computing_on_rmacc_summit_and_beyond#.XH2NBhB7mV4
1137 * GNU Parallel Cheat Sheet by cpriest
1138 https://www.cheatography.com/cpriest/cheat-sheets/gnu-parallel/
1140 * Use Multiple CPU Cores(Parallelize) with Single Threaded Linux
1142 http://xensoft.com/use-multiple-cpu-cores-parallelize-with-single-threaded-linux-commands/
1144 * Bug fixes and man page updates.
1149 * --shard makes it possible to send input to a the same jobslot based
1150 on the value in one column of the input. It is similar to sharding
1153 * --shellquote --shellquote will shell quote the input twice.
1155 * GNU Parallel is available in Termux
1156 https://github.com/termux/termux-packages/tree/master/packages/parallel
1158 * Linux, command line & MetaCentrum
1159 https://trapa.cz/sites/default/files/linux_bash_metacentrum_course_4.pdf
1161 * How to supercharge your bash workflows with GNU parallel
1162 https://medium.freecodecamp.org/how-to-supercharge-your-bash-workflows-with-gnu-parallel-53aab0aea141
1164 * GNU Parallel Spring 2017 https://www.youtube.com/watch?v=LHb29uW_KyI
1166 * Parallelizing Freesurfer blog.cogneurostats.com/?p=148
1168 * FreeSurfer #4: Running recon-all in Parallel https://www.youtube.com/watch?v=XHN2tm3tNaw
1170 * FreeSurfer: recon-all https://www.neurotrivial.com/2019/01/24/freesurfer-recon-all/
1172 * Come ridimensionare 10k foto con la riga di comando
1173 https://pigrecoinfinito.wordpress.com/2018/12/22/come-ridimensionare-10k-foto-con-la-riga-di-comando/
1175 * 并行处理 – Gnu Parallel:嵌套并行
1176 https://codeday.me/bug/20190122/552902.html
1178 * シェルスクリプトでコマンドを並列実行する方法
1179 https://www.kwbtblog.com/entry/2019/01/12/020423
1181 * Bug fixes and man page updates.
1186 * 'env_parallel --end-session' makes it possible to nest 'env_parallel
1189 * Using GNU Parallel in pentesting https://youtu.be/mZ0OUJmkIlA?t=873
1191 * Supercomputer Workshop: Feb 1&7
1192 http://www.ece.unm.edu/featured-students/supercomputer-workshop-feb-17.html
1194 * Bug fixes and man page updates.
1199 * Better /proc/cpuinfo parser.
1201 * Simpler job scheduling flow.
1203 * MPGI Workshop: Job Parallelization with Task Arrays and GNU Parallel
1204 https://www.msi.umn.edu/tutorials/mpgi-workshop-module-4
1206 * CONCOCT uses GNU Parallel
1207 https://media.readthedocs.org/pdf/concoct/latest/concoct.pdf
1209 * If you use SLURM read
1210 https://wiki.hpc.uconn.edu/index.php/Advanced_SLURM
1213 https://qiita.com/hana_shin/items/53c3c78525c9c758ae7c
1215 * Bug fixes and man page updates.
1220 * Experimental simpler job flow control.
1222 * 時間がかかるコマンドを GNU parallel で 並列実行する
1223 https://qiita.com//grohiro/items/4db3fa951a4778c5c479
1225 * Bug fixes and man page updates.
1230 * env_parallel.fish: --session support (alpha quality)
1232 * GNU Parallel was cited in: High-throughput sequencing of murine
1233 immunoglobulin heavy chain repertoires using single side unique
1234 molecular identifiers on an Ion Torrent PGM
1235 https://doi.org/10.18632/oncotarget.25493
1237 * GNU parallel in Japanese Wikipedia
1238 https://ja.wikipedia.org/wiki/GNU_parallel
1240 * Outils de paramétrisation des tâches: lots de tâches, GNU Parallel
1241 https://www.eventbrite.ca/e/inscription-outils-de-parametrisation-des-taches-lots-de-taches-gnu-parallel-et-bqtools-midi-conference-de-50271076142
1243 * Bug fixes and man page updates.
1248 * Minix is supported again.
1250 * Updated graph showing GNU Parallel's overhead per job for each
1251 version. https://www.gnu.org/software/parallel/process-time-j2-1700MHz-3000-1000.pdf
1253 * Intro to Computing at CARC includes introduction to GNU Parallel
1254 http://carc.unm.edu/education--training/workshops-and-seminars.html
1256 * Fast-GBS uses GNU Parallel https://bitbucket.org/jerlar73/fast-gbs/wiki/Home
1258 * Belgium at 10 m resolution in July 2018 http://www.cesbio.ups-tlse.fr/multitemp/?p=14116
1260 * Bug fixes and man page updates.
1265 * parset sets exit code.
1267 * How to install GNU Parallel
1268 https://www.techrepublic.com/videos/how-to-install-gnu-parallel/
1270 * Bug fixes and man page updates.
1275 * The quoting engine has been changed. Instead of using \-quoting GNU
1276 Parallel now uses '-quoting in bash/ash/dash/ksh. This should
1277 improve compatibility with different locales. This is a big change
1278 causing this release to be alpha quality.
1280 * The CPU calculation has changed. By default GNU Parallel uses the
1281 number of CPU threads as the number of CPUs. This can be changed to
1282 the number of CPU cores or number of CPU sockets with
1283 --use-cores-instead-of-threads or --use-sockets-instead-of-threads.
1285 * The detected number of sockets, cores, and threads can be shown with
1286 --number-of-sockets, --number-of-cores, and --number-of-threads.
1288 * env_parallel now support mksh using env_parallel.mksh.
1290 * GNU Parallel is distributed as part of Snippy
1291 https://github.com/tseemann/snippy
1293 * GNU Parallel: Ejecutar comandos simultáneamente en Linux
1294 https://esgeeks.com/gnu-parallel-ejecutar-comandos-simultaneo-linux/
1296 * Parallel download genomic data with GNU-Parallel
1297 https://digibio.blogspot.com/search/label/GNU-Parallel
1299 * Bug fixes and man page updates.
1304 * Deal better with multibyte chars by forcing LC_ALL=C.
1306 * GNU Parallel was introduced in Pincount Podcast:
1307 https://pincountpodcast.com/episodes/29.html
1309 * GNU Parallel was shown on Danish national news for 1.7 seconds: dr.dk
1311 * How to run Linux commands simultaneously with GNU Parallel
1312 https://www.techrepublic.com/article/how-to-run-commands-simultaneously-with-gnu-parallel/#ftag=RSS56d97e7
1314 * Easy parallelization with GNU parallel
1315 http://mpharrigan.com/2016/08/02/parallel.html
1317 * GNU Parallel for mutlithreaded tasks
1318 http://slhogle.github.io/2016/gnu-parallel/
1320 * A GNU Parallel Clustering Demo
1321 https://www.crowdsupply.com/ground-electronics/circumference/updates/a-gnu-parallel-clustering-demo
1323 * 使用 GNU Parallel 提高 Linux 命令行执行效率
1324 https://linux.cn/article-9718-1.html
1326 * Ejecutando tareas desde consola simultáneamente con GNU Parallel
1327 https://poesiabinaria.net/2018/06/ejecutando-tareas-desde-consola-simultaneamente-gnu-parallel/
1329 * Cómo ejecutar varias tareas simultáneamente en el terminal con GNU
1331 https://www.ubuntizando.com/como-ejecutar-varias-tareas-simultaneamente-en-el-terminal-con-gnu-parallel/
1333 * GNU Parallel 활용 가이드 http://genoglobe.kr/kribb/gnu_parallel
1335 * Bug fixes and man page updates.
1340 * --tty allows for more programs accessing /dev/tty in parallel. Some
1341 programs require tty access without using it.
1343 * env_parallel --session will record names in current environment in
1344 $PARALLEL_IGNORED_NAMES and exit. It is only used with env_parallel,
1345 and can work like --record-env but in a single session.
1347 * 35 day course: Linux shell scripting and text processing for big
1348 data https://comquest.in/training
1350 * How To Use Your Entire CPU In Bash With Parallel
1351 https://bash-prompt.net/guides/parallell-bash/
1353 * An easy way to run parallel jobs on Stampede2
1354 https://blog.uta.edu/xus/2017/09/29/an-easy-way-to-run-parallel-jobs-on-stampede2/
1356 * Get more done at the Linux command line with GNU Parallel
1357 https://opensource.com/article/18/5/gnu-parallel
1359 * Save Time with Modern Search Techniques
1360 https://www.sans.org/summit-archives/file/summit-archive-1524582079.pdf
1362 * GNU Parallel: haz más cosas simultáneamente en el terminal
1363 https://blog.desdelinux.net/gnu-parallel-haz-mas-cosas-simultaneamente-en-el-terminal/
1365 * 「今日から使い切る」ための GNU Parallelによる並列処理入門
1366 https://www.slideshare.net/koji_matsuda/gnu-parallel
1368 * Bug fixes and man page updates.
1373 * --csv makes GNU Parallel parse the input sources as CSV. When used
1374 with --pipe it only passes full CSV-records.
1376 * Time in --bar is printed as 1d02h03m04s.
1378 * Optimization of --tee: It spawns a process less per value.
1380 * The GNU Parallel 2018 book is now available:
1381 http://www.lulu.com/shop/ole-tange/gnu-parallel-2018/paperback/product-23558902.html
1383 * Modern pentest tricks for faster, wider, greater engagement (15)
1384 https://conference.hitb.org/hitbsecconf2018ams/materials/D1%20COMMSEC%20-%20Thomas%20Debize%20-%20Modern%20Pentest%20Tricks%20for%20Faster,%20Wider,%20Greater%20Engagements.pdf
1386 * Running many serial jobs efficiently
1387 https://userinfo.surfsara.nl/documentation/running-many-serial-jobs-efficiently
1389 * GNU Parallel: как сохранить результаты нескольких команд для
1390 переменной? http://fliplinux.com/gnu-parallel-6.html
1392 * Running Multiple Commands in Parallel on a GNU Linux
1393 https://www.youtube.com/watch?v=sHpTywpb4_4
1395 * Klaatu covers the documentation of GNU parallel in episode 12x15
1396 http://gnuworldorder.info/
1398 * Bug fixes and man page updates.
1403 * niceload -p can now take multiple pids separated by comma
1405 * --timeout gives a warning when killing processes
1407 * --embed now uses the same code for all supported shells
1409 * --delay can now take arguments like 1h12m07s
1411 * Parallel. Straight from your command line
1412 https://medium.com/@alonisser/parallel-straight-from-your-command-line-feb6db8b6cee
1414 * GNU Parallel was used in POAP-Parallelized Open Babel & Autodock
1415 suite Pipeline https://github.com/inpacdb/POAP
1417 * Pi Cluster Parallel Script First Fire
1418 https://chiefio.wordpress.com/2018/02/23/pi-cluster-parallel-script-first-fire/
1420 * How to Restore MySQL Logical Backup at Maximum Speed
1421 https://www.percona.com/blog/2018/02/22/restore-mysql-logical-backup-maximum-speed/
1423 * Bug fixes and man page updates.
1428 * --embed makes it possible to embed GNU parallel in a shell
1429 script. This is useful if you need to distribute your script to
1430 someone who does not want to install GNU parallel.
1432 * Parallelize Your Large Batches of Small Jobs
1433 https://amito.me/2018/02/Parallelize-Your-Large-Batches-of-Small-Jobs/
1435 * Klaatu expounds upon xargs and talks GNU parallel in episode 12x6
1436 http://gnuworldorder.info/
1438 * How to use parallel to speed up your work
1439 https://mike42.me/blog/how-to-use-parallel-to-speed-up-your-work
1441 * Transient compute clustering with GNU Parallel and sshfs
1442 https://dennismungai.wordpress.com/2018/02/06/transient-compute-clustering-with-gnu-parallel-and-sshfs/
1444 * Useful Examples of ffmpeg and GNU parallel on the command-line
1445 https://dennismungai.wordpress.com/2018/02/06/useful-examples-of-ffmpeg-and-gnu-parallel-on-the-command-line/
1447 * Data Science at the Command Line (Chapter 8.3)
1448 https://www.datascienceatthecommandline.com/
1450 * Bug fixes and man page updates.
1455 * bash / 병렬 https://code.i-harness.com/ko/docs/bash/2a1a
1457 * 15分钟神器gnu parallel 入门观止
1458 http://www.ezilin.com/2018/01/15gnu-parallel.html
1460 * How To Run Multiple Commands In Parallel on Linux
1461 https://www.slashroot.in/how-run-multiple-commands-parallel-linux
1463 * Bug fixes and man page updates.
1468 * env_parset for ash, dash, ksh, sh, zsh
1470 * Automatically create hostgroups if argument ends in @sshlogin
1472 * Tips for running jobs on your VM
1473 https://support.ehelp.edu.au/support/solutions/articles/6000089713-tips-for-running-jobs-on-your-vm#parallel
1475 * Node-local scheduling
1476 https://mogonwiki.zdv.uni-mainz.de/dokuwiki/node_local_scheduling
1478 * GNU Parallel https://docs.computecanada.ca/wiki/GNU_Parallel
1480 * GNU Parallel のエラー処理 https://qiita.com/inouet/items/bfc208668c86caf8ff74
1482 * Using GNU Parallel
1483 https://wiki.ncsa.illinois.edu/display/ROGER/Using+GNU+Parallel
1485 * Bug fixes and man page updates.
1490 * Using GNU Parallel to speed up Google Cloud Infrastructure
1492 https://medium.com/@pczarkowski/using-gnu-parallel-to-speed-up-google-cloud-infrastructure-management-53e5c555ec05
1494 * What is gnu parallel
1495 http://wiki.chpc.ac.za/howto:bioinformatics:gnu-parallel
1497 * Parallel, Scripts, Clusters, & Easy Use
1498 https://chiefio.wordpress.com/2017/11/10/parallel-scripts-clusters-easy-use/
1500 * Bug fixes and man page updates.
1505 * Initial support for XDG Base Directory $XDG_* environment variables.
1507 * Validating half a million TIFF files. Part
1509 https://www.dpoc.ac.uk/2017/08/17/validating-half-a-million-tiff-files-part-two/
1511 * Turing data science class: Cluster computing
1512 https://www.turing.ac.uk/events/masterclass-cluster-computing/
1514 * Butlin:Unix for Bioinformatics - advanced tutorial
1515 https://openwetware.org/wiki/Butlin:Unix_for_Bioinformatics_-_advanced_tutorial
1517 * พยายามใช้ CPU ให้ครบทุก CORE
1518 https://veer66.wordpress.com/2017/09/02/use-multi-core/
1520 * Examples on using GNU Parallel
1521 https://gist.github.com/drmalex07/de8ff1379a560f6d84a0d863e60ae378
1523 * Bug fixes and man page updates.
1528 * Use '--limit myprog' to make a dynamic job limit. Just return 0 to
1529 spawn another job, 1 to not spawn another job, and 2 to kill the
1532 * PARALLEL_RSYNC_OPTS and --rsync-opts sets the options for rsync
1535 * Download all of humble bundle books in parallel
1536 https://til.hashrocket.com/posts/ggt1jaes4y-download-all-of-humble-bundle-books-in-parallel
1538 * Bug fixes and man page updates.
1543 * --line-buffer no longer uses tempfiles. This is faster and makes it
1544 possible for a single process to output more data than there is free
1547 * Vote for GNU Parallel's community ads on
1548 http://meta.unix.stackexchange.com/a/4356/2972
1549 http://meta.askubuntu.com/a/16750/22307
1550 http://meta.serverfault.com/a/9040/45704
1552 * Edit images with GNU Parallel and ImageMagick
1553 https://fedoramagazine.org/edit-images-parallel-imagemagick/
1555 * Running Bash Commands in Parallel
1556 https://dzone.com/articles/running-bash-commands-in-parallel-1
1558 * Today I Learned: GNU parallel, plate tectonics
1559 https://medium.com/@nornagon/today-i-learned-gnu-parallel-plate-tectonics-9fcf24045e63
1561 * GNU Parallel Tutorial
1562 https://www.upf.edu/web/sct-sit/gnu-parallel-tutorial
1564 * Validating half a million TIFF files
1565 http://www.dpoc.ac.uk/2017/08/17/validating-half-a-million-tiff-files-part-two/
1567 * Blender and GNU Parallel
1568 https://www.blendernation.com/2017/08/16/blender-gnu-parallel/
1570 * Quick Introduction to GNU Parallel
1571 https://github.com/LangilleLab/microbiome_helper/wiki/Quick-Introduction-to-GNU-Parallel
1573 * A simple distributed animation render example using GNU Parallel
1574 https://gitlab.com/skororu/scripts
1576 * Do stuff on things, in parallel
1577 http://blogs.fluidinfo.com/terry/2017/08/05/do-stuff-on-things-in-parallel/
1579 * Bash And GNU Parallel NGS Bidniz
1580 http://ino.pm/outreach/presentations/2014/03/genomics-wranglers/index.html
1582 * Using for loop vs Gnu parallel for BLAST
1583 http://www.ettemalab.org/using-for-loop-vs-gnu-parallel-for-blast/
1585 * 并行rsync https://gxnotes.com/article/175866.html
1587 * Bug fixes and man page updates.
1592 * Vote for GNU Parallel's community ads on
1593 http://meta.unix.stackexchange.com/a/4356/2972
1594 http://meta.askubuntu.com/a/16750/22307
1595 http://meta.serverfault.com/a/9040/45704
1597 * GNU Parallel was cited in: Hayabusa: Simple and Fast Full-Text
1598 Search Engine for Massive System Log Data
1599 http://dl.acm.org/citation.cfm?id=3095788
1601 * コマンドの並列化を行える『GNU parallel』の個人的使い方まとめ
1602 https://orebibou.com/2017/07/%E3%82%B3%E3%83%9E%E3%83%B3%E3%83%89%E3%81%AE%E4%B8%A6%E5%88%97%E5%8C%96%E3%82%92%E8%A1%8C%E3%81%88%E3%82%8B%E3%80%8Egnu-parallel%E3%80%8F%E3%81%AE%E5%80%8B%E4%BA%BA%E7%9A%84%E4%BD%BF%E3%81%84/
1604 * How to play and play with thousands of digitized 78rpm records
1605 https://blog.archive.org/2017/07/10/how-to-play-and-play-with-78rpm-record-transfers/
1607 * 并行一个for循环 https://gxnotes.com/article/130363.html
1609 * RFC 8142: GeoJSON Text Sequences
1610 https://sgillies.net/2017/05/18/rfc-8142-geojson-text-sequences.html
1612 * Git auto fetch script I run every day
1613 https://lukas.zapletalovi.com/2017/07/git-auto-fetch-script-i-run-every-day.html
1615 * cores, cpus and threads
1616 http://crazyhottommy.blogspot.de/2017/07/cores-cpus-and-threads.html
1618 * Bug fixes and man page updates.
1623 * The command line can now contain \257 (Macron) or UTF characters
1626 * Vote for GNU Parallel's community ads on
1627 http://meta.unix.stackexchange.com/a/4356/2972
1628 http://meta.askubuntu.com/a/16750/22307
1629 http://meta.serverfault.com/a/9040/45704
1631 * Graph for overhead for 1000 jobs has been updated. It remains
1632 steadily at 3.5 ms per job on a 1.7 GHz machine
1633 https://www.gnu.org/software/parallel/process-time-j2-1700MHz-3000-1000.pdf
1635 * GNU Parallel was cited in: The topology of the directed clique
1636 complex as a network invariant
1637 https://springerplus.springeropen.com/articles/10.1186/s40064-016-2022-y
1639 * GNU Parallel was cited in: Improving Optical Character Recognition
1640 of Finnish Historical Newspapers with a Combination of Fraktur &
1641 Antiqua Models and Image
1642 http://www.ep.liu.se/ecp/131/038/ecp17131038.pdf
1644 * GNU Parallel was cited in: Parallel Execution of Structural Mechanic
1645 Tasks with Use of Small Supercomputers
1646 http://www.sciencedirect.com/science/article/pii/S1877705817324815
1648 * GNU Parallel was cited in: Integration of a Multilingual Preordering
1649 Component into a Commercial SMT Platform
1650 https://www.degruyter.com/downloadpdf/j/pralin.2017.108.issue-1/pralin-2017-0009/pralin-2017-0009.pdf
1652 * Tips For Running Jobs On Your VM
1653 https://support.ehelp.edu.au/support/solutions/articles/6000089713-tips-for-running-jobs-on-your-vm#parallel
1655 * Speed up ML model development with GNU Parallel
1656 https://pzelasko.github.io/posts/speed-up-ml-model-development-with-gnu-parallel
1658 * Parallelizing a Python Function for the Extremely Lazy
1659 http://tdhopper.com/blog/2017/Jun/07/parallelizing-a-python-function-for-the-extremely-lazy/
1662 http://www.android5.online/Android/androidjc/androidkf/gykf/201603/8741.html
1664 * Bug fixes and man page updates.
1669 * --timeout can now use s=second,m=minute,h=hour,d=day.
1671 * --dr is now an alias for --dry-run.
1673 * Vote for GNU Parallel's community ads on
1674 http://meta.unix.stackexchange.com/a/4356/2972
1675 http://meta.askubuntu.com/a/16750/22307
1676 http://meta.serverfault.com/a/9040/45704
1678 * GNU Parallel was cited in: Feature Detection in Visual Cortex during
1679 Different Functional States
1680 https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5397493/
1682 * GNU Parallel was cited in: From genotype to phenotype: inferring
1683 relationships between microbial traits and genomic components
1684 https://docserv.uni-duesseldorf.de/servlets/DerivateServlet/Derivate-44622/main.pdf
1686 * GNU Parallel was cited in: Designing fecal microbiota transplant
1687 trials that account for differences in donor stool efficacy
1688 http://biorxiv.org/content/biorxiv/early/2016/07/25/065383.full.pdf
1690 * GNU Parallel was cited in: Assessing the predictability of
1691 anharmonic vibrational modes at the example of hydroxyl groups - ad
1692 hoc construction of localised modes and the influence of structural
1693 solute–solvent motifs
1694 http://pubs.rsc.org/-/content/articlelanding/2017/cp/c7cp01662j#!divAbstract
1696 * GNU Parallel was cited in: Mapping Environmental Influences on
1698 ftp://frapftp.fire.ca.gov/outgoing/transfer/PUC_Map1/Utility%20Fire%20map%201%20final%20review%20and%20development%20report21616.pdf
1700 * GNU Parallel was cited in: Weak vs. Strong Disorder Superfluid-Bose
1701 Glass Transition in One Dimension
1702 https://arxiv.org/pdf/1704.02257.pdf
1704 * GNU Parallel was cited in: Online Automatic Post-editing for MT in a
1705 Multi-Domain Translation Environment
1706 https://www.aclweb.org/anthology/E/E17/E17-1050.pdf
1708 * GNU Parallel was cited in: Cross-calibration of S-NPP VIIRS
1709 moderate-resolution reflective solar bands against MODIS Aqua over
1711 http://www.atmos-meas-tech.net/10/1425/2017/amt-10-1425-2017.pdf
1713 * GNU Parallel was cited in: Scattering Networks: Efficient 2D
1714 Implementation And Application To Melanoma Classification
1715 http://amslaurea.unibo.it/12261/1/nurrito_eugenio_tesi_fisica_magistrale.pdf
1717 * GNU Parallel was cited in: Genome-scale detection of positive
1718 selection in 9 primates predicts human-virus evolutionary conflicts
1719 http://biorxiv.org/content/biorxiv/early/2017/04/27/131680.full.pdf
1721 * GNU Parallel is used in: Creates a speech dataset for deep learning
1722 https://github.com/jupiter126/Create_Speech_Dataset
1724 * GNU Parallel is used in: Parse and process the demixing secrets
1725 dataset (DSD100) https://github.com/faroit/dsdtools
1727 * First glance at the gnu parallel utility
1728 https://ibiscybernetics.com/blog/2017-04-05.html
1730 * Installing parallel from source
1731 https://bitsanddragons.wordpress.com/2017/05/03/installing-parallel-from-source/
1733 * How to run command or code in parallel in bash shell under Linux or
1735 https://www.cyberciti.biz/faq/how-to-run-command-or-code-in-parallel-in-bash-shell-under-linux-or-unix/
1737 * Parallel Serial Jobs Using GNU Parallel
1738 http://www.hpc.lsu.edu/training/weekly-materials/2017-Spring/gnuparallel-Feb2017.pdf
1740 * GNU Parallel or How to list millions of S3 objects
1741 https://joeray.me/gnu-parallel-how-to-list-millions-objects.html
1743 * Which Is the Best Tool for Copying a Large Directory Tree Locally?
1744 http://arjon.es/2017/05/11/which-is-the-best-tool-for-copying-a-large-directory-tree-locally/
1746 * Bug fixes and man page updates.
1751 * --halt supports done in addition to success and fail.
1753 * parset will set variables in parallel in Bash.
1755 * Perl 5.6 on Irix is no longer supported.
1757 * Vote for GNU Parallel's community ads on
1758 http://meta.unix.stackexchange.com/a/4356/2972
1759 http://meta.askubuntu.com/a/16750/22307
1760 http://meta.serverfault.com/a/9040/45704
1762 * GNU Parallel was cited in: Halvade-RNA: Parallel variant calling
1763 from transcriptomic data using MapReduce
1764 http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0174575
1766 * GNU Parallel was cited in: StrAuto: automation and parallelization
1767 of STRUCTURE analysis
1768 http://bmcbioinformatics.biomedcentral.com/articles/10.1186/s12859-017-1593-0
1770 * GNU Parallel was cited in: Trespassing the Boundaries: Labeling
1771 Temporal Bounds for Object Interactions in Egocentric Video
1772 https://128.84.21.199/pdf/1703.09026.pdf
1774 * GNU Parallel is used in: https://github.com/lucascbeyeler/zmbackup
1776 * Using GNU Parallel
1777 https://wiki.ncsa.illinois.edu/display/ROGER/Using+GNU+Parallel
1779 * Find and xargs and parallel
1780 http://helpful.knobs-dials.com/index.php/Find_and_xargs_and_parallel#Parallel
1782 * Quick Introduction to GNU Parallel
1783 https://github.com/mlangill/microbiome_helper/wiki/Quick-Introduction-to-GNU-Parallel
1785 * Data science at the command line https://www.slideshare.net/sharatsc/data-science-at-the-command-line
1787 * Bedtools笔记 http://www.jianshu.com/p/67b0665490ac
1789 * Bug fixes and man page updates.
1794 * --rpl can now take arguments by adding '(regexp)' in the replacement
1797 * Vote for GNU Parallel's community ads on
1798 http://meta.unix.stackexchange.com/a/4356/2972
1799 http://meta.askubuntu.com/a/16750/22307
1800 http://meta.serverfault.com/a/9040/45704
1802 * GNU Parallel was cited in: shmlast: An improved implementation of
1803 Conditional Reciprocal Best Hits with LAST and Python
1804 https://joss.theoj.org/papers/3cde54de7dfbcada7c0fc04f569b36c7
1806 * GNU Parallel was cited in: Prediction of relativistic electron flux
1807 in the Earth’s outer radiation belt at geostationary orbit by
1809 https://link.springer.com/article/10.1134/S0016793217010108
1811 * GNU Parallel was cited in: Higher likelihood of multiple bit-flips
1812 due to neutron-induced strikes on logic gates
1813 https://arxiv.org/pdf/1612.08239.pdf
1815 * GNU Parallel was cited in: A Monte Carlo Resampling Approach for the
1816 Calculation of Hybrid Classical and Quantum Free Energies
1817 http://pubs.acs.org/doi/pdfplus/10.1021/acs.jctc.6b00506
1819 * GNU Parallel was cited in: Learning string distance with smoothing
1820 for OCR spelling correction
1821 https://link.springer.com/article/10.1007/s11042-016-4185-5
1823 * GNU Parallel was cited in: The Breakdown of String Perturbation
1824 Theory for Many External Particles
1825 https://arxiv.org/pdf/1611.08003.pdf
1827 * GNU Parallel was cited in: Operations Research Applications in
1829 https://dspace.library.colostate.edu/bitstream/handle/11124/170687/Johnson_mines_0052E_11207.pdf?sequence=1&isAllowed=y
1831 * GNU Parallel was cited in: Parallel Computing: GNU Parallel
1832 http://www.blopig.com/blog/2017/02/parallel-computing-gnu-parallel/
1834 * Stig Sandbeck Mathisen: Change All The Passwords (Again)
1835 http://garf.us/2017/02/stig-sandbeck-mathisen-change-all-the-passwords-again/
1837 * Trabalhando como Paralelismo no Bash usando o GNU Parallel
1838 http://www.beyeler.com.br/2017/03/trabalhando-como-paralelismo-no-bash-usando-o-gnu-parallel/
1840 * GNU parallel と SQL*Loader 組み合わせ実行例
1841 https://blogs.oracle.com/LetTheSunShineIn/entry/gnu_parallel_%E3%81%A8_sql_loader
1843 * Bug fixes and man page updates.
1848 * env_parallel now supports /bin/sh, ash, dash.
1850 * --tee will pipe all data to all jobs. Used with --pipe/--pipepart
1851 and :::. Small example: seq 3333 | parallel --pipe --tee --tag 'grep
1852 {} | wc -l' ::: {0..9}
1854 * If --results {replstr} ends in /: save in dir. Otherwise save as
1855 file. Example: parallel --results {} echo {} ::: a b c
1857 * Vote for GNU Parallel's community ads on
1858 http://meta.unix.stackexchange.com/a/4356/2972
1859 http://meta.askubuntu.com/a/16750/22307
1860 http://meta.serverfault.com/a/9040/45704
1862 * GNU Parallel was cited in: Low-delay forwarding with multiple
1863 candidates for VANETs using multi-criteria decision making
1864 http://ieeexplore.ieee.org/document/7835961/
1866 * GNU Parallel was cited in: An Integrated Simulator and Dataset that
1867 Combines Grasping and Vision for Deep Learning
1868 https://arxiv.org/pdf/1702.02103.pdf
1870 * GNU Parallel was cited in: A Bayesian model selection approach for
1871 identifying differentially expressed transcripts from RNA sequencing
1872 data http://onlinelibrary.wiley.com/doi/10.1111/rssc.12213/full
1874 * GNU Parallel was cited in: The impact of copy number variation on
1875 gout, and the apple genome
1876 https://ourarchive.otago.ac.nz/bitstream/handle/10523/7060/BoocockJames2016MSc.pdf?sequence=3
1878 * GNU Parallel was cited in: Reaction rates for reaction-diffusion
1879 kinetics on unstructured meshes
1880 http://aip.scitation.org/doi/10.1063/1.4975167
1882 * GNU Parallel was cited in: Modeling prediction error improves power
1883 of transcriptome-wide association studies
1884 http://biorxiv.org/content/biorxiv/early/2017/02/14/108316.full.pdf
1886 * GNU Parallel was cited in: Proper experimental design requires
1887 randomization/balancing of molecular ecology experiments
1888 http://biorxiv.org/content/biorxiv/early/2017/02/17/109280.full.pdf
1890 * GNU Parallel was cited in: Experiment-based thermal micromagnetic
1891 simulations of the magnetization reversal for ns-range clocked
1893 http://aip.scitation.org/doi/full/10.1063/1.4974021
1895 * GNU Parallel was cited in: The University of Edinburgh’s systems
1896 submission to the MT task at IWSLT
1897 http://workshop2016.iwslt.org/downloads/IWSLT_2016_paper_27.pdf
1899 * Fast-GBS uses GNU Parallel: https://bitbucket.org/jerlar73/fast-gbs
1901 * Job: DevOps Engineer/Senior Systems Administrator in New York, New
1903 http://rockefeller.jobs/new-york-ny/devops-engineersenior-systems-administrator/2DB3408EAC9E4617AD238550F31C7641/job/
1905 * Training in GNU Parallel:
1906 https://www.carc.unm.edu/education-outreach/workshops--training/
1908 * Training in GNU Parallel:
1909 http://www.hpc.lsu.edu/training/registration.php?topic=Parallel%20Serial%20Jobs%20Using%20GNU%20Parallel&date=February%2022,%202017&time=9:00%20AM%20-%2011:00%20AM&place=307%20Frey&deadline=2017-02-21%2016:30:00
1911 * Batch Convert Images from PNG to JPEG
1912 http://coreygoldberg.blogspot.dk/2017/02/batch-convert-images-from-png-to-jpeg.html
1914 * Accelerating Oxford Nanopore Basecalling
1915 http://fowlerlab.org/2017/01/26/accelerating-oxford-nanopore-basecalling/
1917 * parallel и imagemagick в loop на bash
1918 https://www.linux.org.ru/forum/development/13190247
1920 * Bug fixes and man page updates.
1930 * sql now uses a temporary credentials file for MySQL to avoid
1933 * --sqlmaster and --sqlworker have been reworked.
1935 * --sqlworker only reads from the DBURL: any command and any arguments
1938 * --sqlmaster +DBURL will append different commands to the DBURL and
1939 not erase the table.
1941 * If --results contain a replacement string, no tree structure with
1942 args will be generated.
1944 * --fg --tmux or --fg --tmuxpane will connect to the tmux.
1946 * GNU Parallel was cited in: Fast, Automated Indoor Light Detection,
1947 Classification, and Measurement
1948 https://www2.eecs.berkeley.edu/Pubs/TechRpts/2016/EECS-2016-212.pdf
1950 * GNU Parallel was cited in: Unbiased RNA Shotgun Metagenomics in
1951 Social and Solitary Wild Bees Detects Associations with Eukaryote
1952 Parasites and New Viruses
1953 http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0168456
1955 * GNU Parallel was cited in: Almost Event-Rate Independent Monitoring
1956 of Metric Temporal Logic
1957 http://people.inf.ethz.ch/trayteld/papers/tacas17-aerial/aerial.pdf
1959 * 使用GNU parallel命令并行预处理数据: https://blog.razrlele.com/p/1843
1961 * GNU Parallel as a queuing system:
1962 http://puntoblogspot.blogspot.com/2017/01/gnu-parallel-as-queuing-system.html
1964 * AWS re:Invent 2016: Deep Dive on Amazon Elastic File System (STG202)
1966 http://www.slideshare.net/AmazonWebServices/aws-reinvent-2016-deep-dive-on-amazon-elastic-file-system-stg202
1967 and https://youtu.be/PlTuJx4VnGw?t=30m16s
1969 * Bug fixes and man page updates.
1974 * --results foo.csv will save output as a CSV-file. Can be directly
1975 imported into R or LibreCalc.
1977 * When using --pipepart a negative --block-size is not interpreted as
1978 a block size but as the number of blocks each jobslot should have.
1980 * --sqlmaster/--sqlandworker will append jobs to the DBURL if the
1981 DBURL is prepended with +.
1983 * GNU Parallel was cited in: A cloud-based workflow to quantify
1984 transcript-expression levels in public cancer compendia
1985 http://www.nature.com/articles/srep39259
1987 * GNU Parallel was cited in: Determination of crystal structures of
1988 proteins of unknown identity using a marathon molecular replacement
1989 procedure: Structure of Stenotrophomonas maltophilia
1990 phosphate-binding protein
1991 https://www.researchgate.net/publication/308186413_Determination_of_crystal_structures_of_proteins_of_unknown_identity_using_a_marathon_molecular_replacement_procedure_Structure_of_Stenotrophomonas_maltophilia_phosphate-binding_protein
1993 * GNU Parallel was cited in: Large-scale benchmarking reveals false
1994 discoveries and count transformation sensitivity in 16S rRNA gene
1995 amplicon data analysis methods used in microbiome studies
1996 http://microbiomejournal.biomedcentral.com/articles/10.1186/s40168-016-0208-8
1998 * GNU Parallel was cited in: Decomposing Images into Layers via
2000 https://cs.gmu.edu/~ygingold/singleimage/Decomposing%20Images%20into%20Layers%20via%20RGB-space%20Geometry%20(Tan%20et%20al%202016%20TOG)%20small.pdf
2002 * Transient compute clustering with GNU Parallel and sshfs
2003 https://gist.github.com/Brainiarc7/24c966c8a001061ee86cc4bc05826bf4
2005 * 4 Ways to Batch Convert Your PNG to JPG and Vice-Versa
2006 http://www.tecmint.com/linux-image-conversion-tools/
2008 * All's Fair in Love and Distributed Storage
2009 http://cohesity.com/blog/alls-fair-love-distributed-storage/
2011 * How can I use GNU Parallel to run a lot of commands in parallel
2012 https://www.msi.umn.edu/support/faq/how-can-i-use-gnu-parallel-run-lot-commands-parallel
2014 * 정해영의 블로그 - JEONG Haeyoung's blog
2015 http://blog.genoglobe.com/2016/11/gnu-parallel.html
2017 * 在Linux下将PNG和JPG批量互转的四种方法
2018 http://os.51cto.com/art/201612/524182.htm
2020 * Running in parallel http://tomkimpson.com/howto/gnuparallel/
2022 * Taco Bell Parallel Programming
2023 https://giorgos.sealabs.net/taco-bell-parallel-programming.html
2025 * Bug fixes and man page updates.
2030 * --record-env can now be used with env_parallel for bash, ksh, pdksh,
2033 * GNU Parallel was cited in: An improved implementation of Conditional
2034 Reciprocal Best Hits with LAST and Python
2035 https://pypi.python.org/pypi/shmlast/1.0.3
2037 * GNU Parallel was cited in: miRPathDB: a new dictionary on microRNAs
2039 http://nar.oxfordjournals.org/content/early/2016/10/13/nar.gkw926.full
2041 * GNU/Parallel – Run multiple commands simultaneously
2042 https://vinusumi.wordpress.com/2016/11/08/gnuparallel-run-multiple-commands-simultaneously/
2044 * Tutorial: Parallel web scraping with CasperJS and GNU Parallel
2045 http://g-liu.com/blog/2016/10/tutorial-parallel-web-scraping-with-casperjs-and-gnu-parallel/
2047 * Bug fixes and man page updates.
2052 * First command no longer gets stdin as it causes unpredictable issues.
2054 * GNU Parallel was cited in: Efficiently parallelized modeling of
2055 tightly focused, large bandwidth laser pulses
2056 https://arxiv.org/pdf/1609.08146v1.pdf
2058 * How to crunch lots of geodata in parallel
2059 http://blog.faraday.io/how-to-crunch-lots-of-geodata-in-parallel/
2061 * GNU parallel is my new toaster
2062 http://amedee.me/gnu-parallel-is-my-new-toaster/index.html
2064 * Bug fixes and man page updates.
2069 * parcat - cat files or fifos in parallel
2071 * GNU Parallel was cited in: Velocity: A Netflow Based Optimized
2073 https://mospace.umsystem.edu/xmlui/bitstream/handle/10355/50842/Thesis_2016_Pakhare.pdf?sequence=1&isAllowed=y
2075 * GNU Parallel was cited in: Viral deep sequencing needs an adaptive
2076 approach: IRMA, the iterative refinement meta-assembler
2077 http://www.ncbi.nlm.nih.gov/pmc/articles/PMC5011931/
2079 * Using GNU Parallel and ImageMagick for Conversions
2080 https://blog.fractalcomic.com/tutorials/using-gnu-parallel-and-imagemagick-for-conversions/
2082 * Training in GNU Parallel
2083 http://www.cism.ucl.ac.be/Services/Formations/parcomp.pdf
2085 * Chown Ceph OSD data directory using GNU Parallel
2086 http://blog.widodh.nl/2016/08/chown-ceph-osd-data-directory-using-gnu-parallel/
2088 * FastGBS uses GNU Parallel https://bitbucket.org/jerlar73/fastgbs
2090 * dDocent: A guide to ddRAD sequencing
2091 https://ddocent.wordpress.com/ddocent-pipeline-user-guide/
2093 * SOFTWARE GNU Parallel
2094 http://msi-riss.readthedocs.io/en/latest/software/gnu-parallel.html
2096 * Bug fixes and man page updates.
2101 * --tmuxpane opens jobs in panes in tmux. Useful if you want to
2102 monitor progress of less than 100 simultaneous jobs.
2104 * --linebuffer now treats \r as line ending, too.
2106 * Perl changes forces use of floats to be given with leading zero, so
2109 * --xapply renamed to --link.
2111 * Support for pdksh will fade until someone packages it for Ubuntu 16.
2113 * GNU Parallel was cited in: Exome sequencing of geographically
2114 diverse barley landraces and wild relatives gives insights into
2115 environmental adaptation
2116 http://www.nature.com/ng/journal/vaop/ncurrent/full/ng.3612.html?WT.feed_name=subjects_genetics#references
2118 * GNU Parallel was cited in: Vision-Enhanced Lidar Odometry and
2119 Mapping https://www.ri.cmu.edu/pub_files/2016/8/DLL-thesis.pdf
2121 * Easy parallelization with GNU parallel
2122 http://mpharrigan.com/2016/08/02/parallel.html
2124 * Facebook V: Predicting Check Ins, Winner's Interview: 2nd Place,
2126 http://blog.kaggle.com/2016/08/02/facebook-v-predicting-check-ins-winners-interview-2nd-place-markus-kliegl/
2129 http://www.manitou-mail.org/blog/2016/07/parallel-import/
2131 * Large file batch processing using NodeJs and GNU Parallel
2132 http://www.zacorndorff.com/2016/07/27/large-file-batch-processing-using-nodejs-and-gnu-parallel/
2134 * Bug fixes and man page updates.
2139 * env_parallel is now ready for wider testing. It is still beta
2142 * env_parallel is heavily modified for all shells and testing has been
2145 * Selectively choosing what to export using --env now works for
2146 env_parallel (bash, csh, fish, ksh, pdksh, tcsh, zsh).
2148 * --round-robin now gives more work to a job that processes faster
2149 instead of same amount to all jobs.
2151 * --pipepart works on block devices on GNU/Linux.
2153 * GNU Parallel was cited in: HybPiper: Extracting Coding Sequence and
2154 Introns for Phylogenetics from High-Throughput Sequencing Reads
2155 Using Target Enrichment
2156 http://www.bioone.org/doi/full/10.3732/apps.1600016
2158 * GNU Parallel was cited in: StrAuto - Automation and Parallelization
2159 of STRUCTURE Analysis
2160 http://www.crypticlineage.net/download/strauto/strauto_doc.pdf
2162 * GNU Parallel was cited in: Tools and techniques for computational
2164 http://gigascience.biomedcentral.com/articles/10.1186/s13742-016-0135-4
2166 * GNU Parallel was cited in: FlashPCA: fast sparse canonical
2167 correlation analysis of genomic data
2168 http://biorxiv.org/content/biorxiv/suppl/2016/04/06/047217.DC1/047217-1.pdf
2170 * GNU Parallel was cited in: Math Indexer and Searcher under the Hood:
2171 Fine-tuning Query Expansion and Unification Strategies
2172 http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings12/pdf/ntcir/MathIR/05-NTCIR12-MathIR-RuzickaM.pdf
2174 * GNU Parallel was cited in: The Evolution and Fate of
2175 Super-Chandrasekhar Mass White Dwarf Merger Remnants
2176 http://arxiv.org/pdf/1606.02300.pdf
2178 * GNU Parallel was cited in: Evaluation of Coastal Scatterometer
2180 https://mdc.coaps.fsu.edu/scatterometry/meeting/docs/2016/Thu_AM/coastal-poster.pdf
2182 * GNU Parallel was used in: https://github.com/splitice/bulkdnsblcheck
2184 * The iconv slurp misfeature
2185 http://www.openfusion.net/linux/iconv_slurp_misfeature
2187 * แบบว่า CPU เหลือ https://veer66.wordpress.com/2016/06/15/gnu-parallel/
2189 * Bug fixes and man page updates.
2194 * $PATH can now be exported using --env PATH. Useful if GNU Parallel
2195 is not in your path on remote machines.
2197 * If --block is left out, --pipepart will use a block size that will
2198 result in 10 jobs per jobslot.
2200 * The cookie from 2016-01-04 was won by Morgan Rodgers on the
2201 2016-06-06 after 5 months.
2203 * Vote for GNU Parallel's community ad on
2204 https://meta.askubuntu.com/questions/14925/community-promotion-ads-2016/15046#15046
2206 * GNU Parallel was cited in: Genotypic Resistance Tests Sequences
2207 Reveal the Role of Marginalized Populations in HIV-1 Transmission in
2208 Switzerland http://www.nature.com/articles/srep27580
2210 * GNU Parallel was cited in: A Deep-Learning Approach for Operation of
2211 an Automated Realtime Flare Forecast
2212 https://arxiv.org/pdf/1606.01587.pdf
2214 * Unix parallel: Populating all the USB sticks
2215 http://www.markhneedham.com/blog/2016/06/01/unix-parallel-populating-all-the-usb-sticks/
2217 * GNU Parallel is a fantastic utility https://www.dray.be/parallel/
2219 * Combining a large number of VCF files
2220 https://gtamazian.com/2016/06/16/combining-a-large-number-of-vcf-files/
2222 * Useful Scraping Techniques
2223 http://blog.apps.npr.org/2016/06/17/scraping-tips.html
2225 * Tools of the trade
2226 http://onox.com.br/2015/05/tools-of-the-trade/#more-198
2228 * Armslist scraper https://github.com/nprapps/armslist-scraper/
2230 * Bug fixes and man page updates.
2235 * niceload --net pauses the program if the internet connection is
2238 * Vote for GNU Parallel's community ad on
2239 https://meta.askubuntu.com/questions/14925/community-promotion-ads-2016/15046#15046
2241 * Updated speed comparison between versions
2242 https://www.gnu.org/software/parallel/process-time-j2-1700MHz-3000-1000.pdf
2244 * GNU Parallel was cited in: Improving computation efficiency by
2245 parallel programming
2246 http://www.irbis-nbuv.gov.ua/cgi-bin/irbis_nbuv/cgiirbis_64.exe?C21COM=2&I21DBN=UJRN&P21DBN=UJRN&IMAGE_FILE_DOWNLOAD=1&Image_file_name=PDF/ape_2013_3_44.pdf
2248 * GNU Parallel was cited in: A supernova feedback implementation for
2249 the astrophysical simulation software Arepo
2250 https://arxiv.org/abs/1604.06071
2252 * GNU Parallel was cited in: Lorenz-Mie theory for 2D scattering and
2253 resonance calculations https://arxiv.org/pdf/1505.07691v2.pdf
2255 * GNU Parallel was cited in: Host-pathogen co-evolution and the
2256 emergence of broadly neutralizing antibodies in chronic infections
2257 https://arxiv.org/abs/1512.06296
2259 * GNU Parallel was cited in: Pacific People, Metabolic Disease and
2260 Evolutionary Processes: a mitochondrial DNA study
2261 https://otago.ourarchive.ac.nz/handle/10523/6340
2263 * GNU Parallel was cited in: The effect of domain modeling on
2264 efficiency of planning: Lessons from the Nomystery domain
2265 http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=7407131
2267 * GNU Parallel was cited in: Oops, my tests broke the build: An
2268 analysis of Travis CI builds with GitHub
2269 https://peerj.com/preprints/1984/
2271 * GNU Parallel was cited in: Drosophila Muller F Elements Maintain a
2272 Distinct Set of Genomic Properties Over 40 Million Years of
2273 Evolution http://www.g3journal.org/content/5/5/719.full.pdf+html
2275 * GNU Parallel was cited in: An Empirical Comparison of Neural
2276 Architectures for Reinforcement Learning in Partially Observable
2278 http://biorxiv.org/content/biorxiv/early/2016/03/24/022707.full.pdf
2280 * GNU Parallel was cited in: PleaseTM: Enabling Transaction Conflict
2281 Management in Requester-wins Hardware Transactional Memory
2282 http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7446072
2284 * GNU Parallel was cited in: EASE-MM: Sequence-Based Prediction of
2285 Mutation-Induced Stability Changes with Feature-Based Multiple
2287 http://www.sciencedirect.com/science/article/pii/S0022283616000310
2289 * GNU Parallel was cited in: A new orthology assessment method for
2290 phylogenomic data: Unrooted Phylogenetic Orthology
2291 http://mbe.oxfordjournals.org/content/early/2016/04/06/molbev.msw069.short
2292 https://github.com/ballesterus/UPhO
2294 * GNU Parallel was cited in: Distinctive Interest Point Selection for
2295 Efficient Near-duplicate Image Retrieval
2296 http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7459172
2298 * GNU Parallel was cited in: The Evolution of C Programming Practices:
2299 A Study of the Unix Operating System 1973–2015
2300 https://dl.acm.org/citation.cfm?id=2884799 (It has the cutest
2301 thumbnail graphs I have ever seen scattered all over the text)
2303 * GNU Parallel was cited in: Data processing pipeline for serial
2304 femtosecond crystallography at SACLA
2305 http://journals.iucr.org/j/issues/2016/03/00/zw5001/index.html
2307 * GNU Parallel was cited in: Reconstruction of Fine-Scale Auroral
2308 Dynamics http://arxiv.org/pdf/1512.01460.pdf
2310 * GNU Parallel was cited in: Genomic legacy of the African cheetah,
2312 https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4676127/pdf/13059_2015_Article_837.pdf
2314 * GNU Parallel was cited in: Don’t Forget to Lock the Back Door! A
2315 Characterization of IPv6 Network Security Policy
2316 http://benign-research-probe2.eecs.umich.edu/ndss16_ipv6_final.pdf
2318 * GNU Parallel was cited in: Comprehensive Annotation of the
2319 Parastagonospora nodorum Reference Genome Using Next-Generation
2320 Genomics, Transcriptomics and Proteogenomics
2321 http://journals.plos.org/plosone/article/asset?id=10.1371%2Fjournal.pone.0147221.PDF
2323 * GNU Parallel was cited in: How attention influences perceptual
2324 decision making: Single-trial EEG correlates of drift-diffusion
2325 model parameters http://www.cidlab.com/prints/nunez2016attention.pdf
2327 * GNU Parallel was cited in: Telomere And Proximal Sequence Analysis
2328 Using High-Throughput Sequencing Reads
2329 http://repository.upenn.edu/edissertations/1460/
2331 * GNU Parallel was cited in: AT-GIS: Highly Parallel Spatial Query
2332 Processing with Associative Transducers
2333 http://lsds.doc.ic.ac.uk/sites/default/files/ATGIS-SIGMOD16.pdf
2335 * GNU Parallel was cited in: PVAIR: Partial Variable Assignment
2336 InterpolatoR http://verify.inf.usi.ch/sites/default/files/main-2.pdf
2338 * GNU Parallel was cited in: Comparative Cladistics: Fossils,
2339 Morphological Data Partitions and Lost Branches in the Fossil Tree
2340 of Life http://opus.bath.ac.uk/43955/
2342 * GNU Parallel was cited in: Shannon: An Information-Optimal de
2343 NovoRNA-Seq Assembler
2344 http://biorxiv.org/content/biorxiv/early/2016/02/09/039230.full.pdf
2346 * GNU Parallel was cited in: Adaptive Measure-Theoretic Parameter
2347 Estimation for Coastal Ocean Modeling
2348 https://repositories.lib.utexas.edu/handle/2152/32435
2350 * GNU Parallel was cited in: Computational Design of DNA-Binding
2352 http://link.springer.com/protocol/10.1007/978-1-4939-3569-7_16
2354 * GNU Parallel was cited in: Reference genotype and exome data from an
2355 Australian Aboriginal population for health-based research
2356 http://www.nature.com/articles/sdata201623
2358 * GNU Parallel was cited in: Do aye-ayes echolocate?
2359 http://biorxiv.org/content/biorxiv/early/2016/04/11/048165.full.pdf
2361 * GNU Parallel was cited in: Functional enrichments of disease
2362 variants across thousands of independent loci in eight diseases
2363 http://biorxiv.org/content/biorxiv/early/2016/04/11/048066.full.pdf
2365 * GNU Parallel was cited in: From genomes to phenotypes: Traitar, the
2366 microbial trait analyzer
2367 http://biorxiv.org/content/biorxiv/early/2016/03/12/043315.full.pdf
2369 * GNU Parallel was mentioned in: Fast Playback Framework for Analysis
2370 of Ground-Based Doppler Radar Observations Using MapReduce
2372 http://journals.ametsoc.org/doi/pdf/10.1175/JTECH-D-15-0118.1
2374 * NCBI blast tutorial
2375 https://github.com/enormandeau/ncbi_blast_tutorial
2377 * Distributed Preservation Made Simple
2378 https://blog.archive.org/2016/02/26/distributed-preservation-made-simple/
2380 * Parallel Jobs in Luigi http://rjbaxley.com/posts/2016/03/13/parallel_jobs_in_luigi.html
2382 * Bug fixes and man page updates.
2387 * :::+ and ::::+ work like ::: and :::: but links this input source to
2388 the previous input source in a --xapply fashion. Contrary to
2389 --xapply values do not wrap: The shortest input source determines
2392 * --line-buffer --keep-order now outputs continously from the oldest
2393 job still running. This is more what you would expect than the
2394 earlier behaviour where --keep-order had no effect with
2397 * env_parallel supports tcsh, csh, pdksh. In fish it now supports
2398 arrays. In csh/tcsh it now supports variables, aliases, and arrays
2399 with no special chars. In pdksh it supports aliases, functions,
2400 variables, and arrays.
2402 * Function exporting on Mac OS X works around old Bash version.
2404 * Better CPU detection on OpenIndiana.
2406 * GNU Parallel was cited in: Automatic Methods for Assisted
2408 https://www.researchgate.net/publication/297738658_Automatic_Methods_for_Assisted_Recruitment
2410 * GNU Parallel was cited in: Reinterpretation of ATLAS 8 TeV searches
2411 for Natural SUSY with a R-Sneutrino LSP
2412 http://arxiv.org/pdf/1603.06130.pdf
2414 * GNU Parallel was cited in: An Operational Radiometric Landsat
2415 Preprocessing Framework for Large-Area Time Series Applications
2416 https://www.uni-trier.de/fileadmin/fb6/prof/FER/Publikationen/frantz_et_al_ieee-tgrs-2016-post-print.pdf
2418 * A basic demo of how GNU Parallel can speed up execution of commands
2419 https://www.youtube.com/watch?v=kl8LO2jcvMc
2421 * qbatch uses GNU Parallel: https://pypi.python.org/pypi/qbatch/1.0rc2
2423 * FaceCrop uses GNU Parallel: https://github.com/EderSantana/FaceCrop
2425 * Parallel Processing with Catmandu
2426 https://librecatproject.wordpress.com/2016/04/20/parallel-processing-with-catmandu/
2429 http://staypython.blogspot.dk/2016/04/gnu-parallel.html
2431 * Bug fixes and man page updates.
2436 * env_parallel is a function that exports the environment (functions,
2437 aliases, variables, and arrays) to GNU Parallel. Run 'man
2438 env_parallel' for details.
2440 * niceload --prg now searches for substrings if no process with the
2443 * GNU Parallel was cited in: Random Forest DBSCAN for USPTO Inventor
2444 Name Disambiguation http://arxiv.org/pdf/1602.01792.pdf
2446 * GNU Parallel was mentioned (with wrong citation) in: Dual Level
2447 Parallel Computations for LargeScale High-Fidelity Database to
2448 Design Aerospace Vehicles
2449 http://www.nas.nasa.gov/assets/pdf/papers/Guruswamy_2013_DualLevelParallelComputations.pdf
2451 * Using ‘Parallel’ in Unix
2452 https://shearnrylan.wordpress.com/2016/02/22/using-parallel-in-unix/
2454 * JPEG Squish uses (and co-distributes) GNU Parallel:
2455 http://dantidswell.co.uk/jpeg-squish/
2457 * Bug fixes and man page updates.
2462 * Vote for new community on Superuser, Ask Ubuntu, Unix&Linux
2463 http://meta.superuser.com/questions/11127/community-promotion-ads-2016/11225#11225
2464 http://meta.askubuntu.com/questions/14925/community-promotion-ads-2016/15046#15046
2465 http://meta.unix.stackexchange.com/questions/3854/community-promotion-ads-2016/3893#3893
2467 * Daily Quick Tip: parallel
2468 https://medium.com/@jacaetevha/daily-quick-tip-parallel-8772435f6582
2470 * Downloading a list of URLs
2471 http://blog.gypsydave5.com/2016/02/04/xargs-and-curl/
2473 * Using GNU Parallel and ImageMagick for Conversions
2474 http://blog.fractalcomic.com/tutorials/using-gnu-parallel-and-imagemagick-for-conversions/
2476 * Running bash commands in parallel
2477 http://linuxcommando.blogspot.dk/2016/01/running-bash-commands-in-parallel.html
2479 * parallel processing in PDAL
2480 https://smathermather.wordpress.com/2016/01/28/parallel-processing-in-pdal/
2482 * A Million Text Files And A Single Laptop
2483 http://randyzwitch.com/gnu-parallel-medium-data/
2485 * 「今日から使い切る」ための GNU Parallelによる並列処理入門
2486 http://www.slideshare.net/koji_matsuda/gnu-parallel
2488 * Bug fixes and man page updates.
2493 * --sql DBURL uses DBURL as storage for jobs and output. It does not
2494 run any jobs so it requires at least one --sqlworker. DBURL must
2497 * --sqlworker DBURL gets jobs from DBURL and stores the result back to
2500 * --sqlandworker is a shorthand for --sql and --sqlworker.
2502 * --sqlworker requires the output of a single job to fit in memory.
2504 * --results now also saves a file called 'seq' containing the sequence
2507 * If $PARALLEL_ENV is a file, then that file will be read into
2510 * man parallel_tutorial has been given an overhaul.
2512 * --workdir now accepts replacementstrings.
2514 * GNU Parallel was cited in: Possum - A Framework for
2515 Three-Dimensional Reconstruction of Brain Images from Serial
2516 Sections http://link.springer.com/article/10.1007/s12021-015-9286-1
2518 * GNU Parallel was cited in: A Genetic Algorithm for the selection of
2519 structural MRI features for classification of Mild Cognitive
2520 Impairment and Alzheimer's Disease
2521 http://ieeexplore.ieee.org/xpl/abstractReferences.jsp?tp=&arnumber=7359909&url=http%3A%2F%2Fieeexplore.ieee.org%2Fxpls%2Fabs_all.jsp%3Farnumber%3D7359909
2523 * GNU Parallel was cited in: The Effect of Domain Modeling on
2524 Performance of Planning Algorithms
2525 http://isaim2016.cs.virginia.edu/papers/ISAIM2016_Bartak_Vodrazka.pdf
2527 * Plotting time tables for jobs run by GNU Parallel
2528 https://github.com/ziotom78/plot_joblog
2530 * GNU Parallel was used in: Mission Impossible: you have 1 minute to
2531 analyze the Ebola Genome https://www.biostars.org/p/119397
2533 * GNU Parallel is used in LAST: http://last.cbrc.jp/
2535 * Distributed Log Search Using GNU Parallel
2536 http://codehate.com/blog/2015/12/01/distributed-log-search-using-gnu-parallel/
2538 * Bug fixes and man page updates.
2543 * --transfer is now an alias for --transferfile {}.
2545 * --transferfile works like --transfer, but takes an argument like
2546 --return. This makes it possible to combine transferring files
2547 with multiple input sources: parallel -S server --tf {1} wc {2}
2548 {1} ::: * ::: -l -w -c
2550 * total_jobs() can now be used in {= =}: parallel echo job {#} of '{=
2551 $_=total_jobs() =}' ::: {1..50}
2553 * GNU Parallel was cited in: Evolution and Learning in Heterogeneous
2555 http://research.gold.ac.uk/15078/1/COM_thesis_JonesD_2015.pdf
2557 * GNU Parallel was cited in: Achieving Consistent Doppler Measurements
2558 from SDO/HMI Vector Field Inversions
2559 http://arxiv.org/pdf/1511.06500.pdf
2561 * Flo uses GNU Parallel: https://github.com/wurmlab/flo
2563 * 使用 GNU parallel 來平行運算
2564 http://mutolisp.logdown.com/posts/316959-using-gnu-parallel-to-parallel-computing
2566 * Bug fixes and man page updates.
2571 * GNU Parallel packaged for CERN CentOS:
2572 http://linuxsoft.cern.ch/cern/centos/7/cern/x86_64/repoview/parallel.html
2574 * GNU Parallel was cited in: The Outer Solar System Origins Survey:
2575 I. Design and First-Quarter Discoveries
2576 http://arxiv.org/pdf/1511.02895.pdf
2578 * GNU Parallel was cited in: Contrasting genetic architectures of
2579 schizophrenia and other complex diseases using fast
2580 variance-components analysis
2581 http://www.nature.com/ng/journal/vaop/ncurrent/full/ng.3431.html
2583 * GNU Parallel was cited in: Named-Entity Chunking for Norwegian Text
2584 using Support Vector Machines
2585 http://ojs.bibsys.no/index.php/NIK/article/viewFile/248/211
2587 * GNU Parallel was cited in: Multiscale Estimation of Binding Kinetics
2588 Using Brownian Dynamics, Molecular Dynamics and Milestoning
2589 http://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1004381#pcbi.1004381.ref072
2591 * GNU Parallel was cited in: A Detailed Characterization of Errors in
2592 Logic Circuits due to Single-Event Transients
2593 http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=7302348&url=http%3A%2F%2Fieeexplore.ieee.org%2Fxpls%2Fabs_all.jsp%3Farnumber%3D7302348
2595 * GNU Parallel was cited in: Arabic Speaker Emotion Classification
2596 Using Rhythm Metrics and Neural Networks
2597 http://www.eurasip.org/Proceedings/Eusipco/Eusipco2015/papers/1570104855.pdf
2599 * GNU Parallel was cited in: Stride Search: a general algorithm for
2600 storm detection in high resolution climate data
2601 http://www.geosci-model-dev-discuss.net/8/7727/2015/gmdd-8-7727-2015.pdf
2603 * GNU Parallel was cited in: Decomposing Digital Paintings into Layers
2604 via RGB-space Geometry http://arxiv.org/pdf/1509.03335.pdf
2606 * GNU Parallel was cited in: Structure and evolutionary history of a
2607 large family of NLR proteins in the zebrafish
2608 http://www.biorxiv.org/content/biorxiv/early/2015/09/18/027151.full.pdf
2610 * GNU Parallel was cited in: Evolution of movement strategies under
2611 competitive interactions
2612 http://digital.csic.es/bitstream/10261/115973/1/evolution_movement_strategies_Kiziridis.pdf
2614 * Automating large numbers of tasks
2615 https://rcc.uchicago.edu/docs/tutorials/kicp-tutorials/running-jobs.html
2617 * Max out your IOPs with GNU Parallel
2618 http://blog.bitratchet.com/2015/11/11/max-out-your-iops-with-gnu-parallel/
2620 * Bug fixes and man page updates.
2625 * --plus makes it possible to use {##} as a shorthand for
2626 {= $_=$Global::JobQueue->total_jobs() =} which gives the the number
2627 of jobs to run in total.
2629 * {= $_=$Global::JobQueue->total_jobs() =} is incompatible with -X,
2632 * GNU Parallel is now mostly compatible with lsh
2633 (http://www.lysator.liu.se/~nisse/lsh/) and somewhat compatible with
2634 autossh (http://www.harding.motd.ca/autossh/).
2636 * --workdir ... now also works when run locally.
2638 * GNU Parallel was cited in: There is no (75, 32, 10, 16) strongly
2639 regular graph http://arxiv.org/pdf/1509.05933.pdf
2641 * GNU Parallel was cited in: Roary: rapid large-scale prokaryote pan
2643 http://bioinformatics.oxfordjournals.org/content/early/2015/08/05/bioinformatics.btv421.full.pdf+html
2645 * GNU Parallel is used in TraitAR:
2646 https://testpypi.python.org/pypi/traitar/0.1.4
2648 * A parallel and fast way to download multiple files
2649 http://onetipperday.blogspot.com/2015/10/a-parallel-and-fast-way-to-download.html
2651 * Usar GNU Parallel para aumentar el rendimiento de tus scripts
2652 http://adrianarroyocalle.github.io/blog/2015/10/20/usar-gnu-parallel/
2654 * Bug fixes and man page updates.
2659 * GNU Parallel was cited in: Flexible Modeling of Epidemics with an
2660 Empirical Bayes Framework
2661 http://journals.plos.org/ploscompbiol/article?id=10.1371%2Fjournal.pcbi.1004382
2663 * GNU Parallel was cited in: BL1: 2D Potts Model with a Twist
2664 https://sucs.swan.ac.uk/~rjames93/Dissertation.pdf
2666 * GNU Parallel was cited in: A Scalable Parallel Implementation of
2667 Evolutionary Algorithms for Multi-Objective Optimization on GPUs
2668 http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7257074
2670 * GNU Parallel was cited in: How Can We Measure the Similarity Between
2671 Résumés of Selected Candidates for a Job?
2672 https://www.researchgate.net/publication/275954089_How_can_we_measure_the_similarity_between_rsums_of_selected_candidates_for_a_job
2674 * GNU Parallel was cited in: Interplay of cell dynamics and epithelial
2675 tension during morphogenesis of the Drosophila pupal wing
2676 http://www.researchgate.net/profile/Raphael_Etournay/publication/279061859_Interplay_of_cell_dynamics_and_epithelial_tension_during_morphogenesis_of_the_Drosophila_pupal_wing/links/558a95ad08aeae8413bcceea.pdf
2678 * Third-party selling GNU Parallel T-shirts
2679 http://www.aliexpress.com/item/2015F-BSO-GNU-LOGO-GNU-PARALLEL-men-s-shirt-sleeve-visual-illusion-error/32464827966.html
2681 * Joys of gnu parallel
2682 http://scottolesen.com/index.php/2015/08/26/joys-of-gnu-parallel/
2684 * Crop and resize images with bash and ImageMagick
2685 https://www.simonholywell.com/post/2015/08/image-resize-crop-bash-imagemagick/
2687 * Three Ways to Script Processes in Parallel
2688 http://www.codeword.xyz/2015/09/02/three-ways-to-script-processes-in-parallel/
2690 * What It Looks Like to Process 3.5 Million Books
2691 http://blog.gdeltproject.org/what-it-looks-like-to-process-3-5-million-books/
2693 * Bug fixes and man page updates.
2698 * If $job->skip() is called in {= =} the job will not be run.
2700 * @arg can now be used in {= =}: parallel echo '{= $arg[2] < 5 and
2701 $_="j" =}' ::: 1 2 3 ::: 4 5 6
2703 * Version of GNU Parallel that uses PostgreSQL as backend
2704 https://github.com/stephen-fralich/parallel-sql/
2706 * SpeedSeq: ultra-fast personal genome analysis and interpretation
2707 http://www.nature.com/nmeth/journal/vaop/ncurrent/full/nmeth.3505.html
2709 * GNU Parallel is used in elPrep: https://github.com/ExaScience/elprep
2711 * Who actually reads the code?
2712 http://www.fsf.org/blogs/community/who-actually-reads-the-code
2714 * Introduction to GNU Parallel
2715 http://erictleung.com/2015/08/06/intro-to-gnu-parallel/
2717 * ¿Alguien se lee el código?
2718 http://www.taringa.net/post/linux/18854759/Alguien-se-lee-el-codigo.html
2720 * ¿Quién se lee el código fuente?
2721 https://victorhckinthefreeworld.wordpress.com/2015/08/12/quien-se-lee-el-codigo-fuente/
2723 * Distribution des traitements avec GNU Parallel
2724 http://blog.inovia-conseil.fr/?p=226#4
2726 * Эксперимент по проверке, читают ли код открытых проектов
2727 http://www.opennet.ru/opennews/art.shtml?num=42718
2729 * 多核心主機搭配 GNU parallel
2730 http://blog.zeroplex.tw/2015/08/gnu-parallel.html
2732 * Bug fixes and man page updates.
2737 * If a record fits in a block, --block only reads upto the size of
2738 --block. If not: --block reads a full --block more.
2740 * Due to widely spread distributions still using --tollef even after a
2741 year of being retired following a year of being obsolete, --tollef
2742 now gives an error unless used with --gnu.
2744 * --nice now uses a perl wrapper instead of the nice command.
2746 * Cookie 2013-08-18 was won by Mark Maimone, 1 year and 11 months
2749 * A parser for GNU Parallel --joblog files:
2750 https://github.com/harryjubb/joblog
2752 * GNU Parallel was cited in: Dynamical formation & scattering of
2753 hierarchical triples: Cross sections, Kozai-Lidov oscillations, and
2754 collisions http://arxiv.org/pdf/1507.03593.pdf
2756 * GNU Parallel was cited in: A Fast Compiler for NetKAT
2757 http://arxiv.org/pdf/1506.06378.pdf
2759 * GNU Parallel was cited in: Decomposing Time-Lapse Paintings into
2761 http://cs.gmu.edu/~ygingold/timemap/Decomposing%20Time-Lapse%20Paintings%20into%20Layers%20(Tan%20et%20al%202015%20SIGGRAPH)%20600dpi.pdf
2763 * GNU Parallel was used in: Somatic mutation calling from the matched
2764 tumor-normal exome-sequencing
2765 http://fafner.meb.ki.se/biostatwiki/somac/
2767 * Parallel Processing from the Command Line
2768 https://www.perpetual-beta.org/weblog/parallel-processing-from-the-command-line.html
2770 * Using GNU Parallel to speed up network operations
2771 http://vielmetti.typepad.com/vacuum/2015/06/using-gnu-parallel-to-speed-up-network-operations.html
2773 * Crawl faster with "parallel" - but how fast?
2774 http://andreas-wpv.blogspot.com/2015/07/crawl-faster-with-parallel-but-how-fast.html
2776 * Simultaneously benchmark many URLs with ApacheBench and GNU parallel
2777 https://www.simonholywell.com/post/2015/06/parallel-benchmark-many-urls-with-apachebench/
2779 * Bug fixes and man page updates.
2784 * --halt has been rewritten completely. You can now combine
2785 percentages with success or fail. See the man page.
2787 * Exit values 102..254 have been removed. 101 means more than 100 jobs
2790 * Killing through --timeout, --memfree, or --halt is now done as a
2793 * --termseq determines which signals are sent when a job is killed.
2795 * An empty argument would previously cause no string to be
2796 inserted. This is now changed to '' being inserted, thus prepending
2797 a space to the output of: parallel echo {} b ::: ''
2799 * $PARALLEL_ENV can now be set to an environment prepending the
2800 command. Used in env_parallel as mentioned in the manpage.
2802 * --retry-failed will retry all failed jobs in a joblog. It will
2803 ignore any command given.
2805 * --ssh and $PARALLEL_SSH can be used to set the command used for
2806 ssh. The command is assumed to behave the same way as ssh.
2808 * --fifo now works in csh, too.
2810 * Q(...) can be used in {= =} to shell quote a string.
2812 * GNU Parallel was cited in: DockBench: An Integrated Informatic
2813 Platform Bridging the Gap between the Robust Validation of Docking
2814 Protocols and Virtual Screening Simulations
2815 http://www.mdpi.com/1420-3049/20/6/9977
2817 * GNU Parallel was cited in: Swedes Online: You Are More Tracked Than
2819 http://www.diva-portal.org/smash/get/diva2:807623/FULLTEXT01.pdf
2821 * GNU Parallel was cited in: Tutorial: Lorenz-Mie theory for 2D
2822 scattering and resonance calculations
2823 http://arxiv.org/pdf/1505.07691.pdf
2825 * GNU Parallel was cited in: A quantitative assessment of the Hadoop
2826 framework for analyzing massively parallel DNA sequencing data
2827 http://link.springer.com/article/10.1186/s13742-015-0058-5
2829 * GNU Parallel was cited in: A composite genome approach to identify
2830 phylogenetically informative data from next-generation sequencing
2831 http://www.biomedcentral.com/content/pdf/s12859-015-0632-y.pdf
2833 * GNU Parallel is used in: taxator-tk
2834 http://algbio.cs.uni-duesseldorf.de/webapps/wa-download/
2836 * GNU Parallel is used in: https://github.com/d2207197/local-mapreduce
2838 * GNU Parallel is used in: wiki-edit-news https://github.com/albert-decatur/wiki-edit-news
2840 * GNU Parallel is used in: A Fingerprint Identification System
2841 https://curve.carleton.ca/system/files/theses/28733.pdf
2843 * Job ad asking for GNU Parallel experience:
2844 http://searchjobs.intel.com/gdansk-pol/software-validation-engineer/63A06826DAF24797AB414DC146201C2E/job/
2846 * Using BLAT http://wangzhengyuan.blogspot.dk/2015/06/using-blat.html
2848 * Bug fixes and man page updates.
2853 * Security: The security issue for --sshlogin + --fifo/--cat has been
2854 fixed. Thereby all issues with
2855 http://lists.gnu.org/archive/html/parallel/2015-04/msg00045.html
2858 * Security: After further security analysis the issue fixed in
2859 20150422 also fixed the problem for --tmux.
2861 * GNU Parallel was cited in: CIDER: a pipeline for detecting waves of
2862 coordinated transcriptional regulation in gene expression
2864 http://biorxiv.org/content/biorxiv/early/2015/03/17/012518.full.pdf
2866 * GNU Parallel was cited in: Building Genomic Analysis Pipelines in a
2867 Hackathon Setting with Bioinformatician Teams: DNA-seq, Epigenomics,
2868 Metagenomics and RNA-seq
2869 http://biorxiv.org/content/biorxiv/early/2015/05/05/018085.full.pdf
2871 * GNU Parallel was cited in: Sequencing the cap-snatching repertoire
2872 of H1N1 influenza provides insight into the mechanism of viral
2873 transcription initiation
2874 http://nar.oxfordjournals.org/content/early/2015/04/20/nar.gkv333.full.pdf
2876 * GNU Parallel was cited in: Genome assembly using Nanopore-guided
2877 long and error-free DNA reads
2878 http://www.biomedcentral.com/content/pdf/s12864-015-1519-z.pdf
2880 * GNU Parallel was used (unfortunately with wrong citation) in:
2881 Comparing the CarbonTracker and TM5-4DVar data assimilation systems
2882 for CO2 surface flux inversions
2883 http://www.atmos-chem-phys-discuss.net/15/8883/2015/acpd-15-8883-2015-discussion.html
2885 * GNU Parallel was used in: Gene Set Omic Analysis (GSOA) method
2886 https://bitbucket.org/srp33/gsoa
2888 * A Quick and Neat :) Orchestrator using GNU Parallel
2889 http://www.elsotanillo.net/2015/05/a-quick-and-neat-orchestrator-using-gnu-parallel/
2891 * Execute commands on multiple computers using GNU Parallel (setting
2892 up a cluster on the cheap)
2893 https://spectraldifferences.wordpress.com/2015/04/26/execute-commands-on-multiple-computers-using-gnu-parallel-setting-up-a-cluster-on-the-cheap/
2895 * Functions and GNU parallel for effective cluster load management
2896 http://genomespot.blogspot.dk/2015/04/functions-and-gnu-parallel-for.html
2898 * Use parallel processing to save time importing databases
2899 http://drupalsun.com/node/41854
2901 * Run multiple ssh commands in parallel with GNU Parallel
2902 http://www.ameir.net/blog/archives/380-run-multiple-ssh-commands-in-parallel-with-gnu-parallel.html
2904 * Importing huge databases faster
2905 https://www.lullabot.com/blog/article/importing-huge-databases-faster
2907 * Parallel? Gnu parallel! https://debian.pro/1834
2909 * Bug fixes and man page updates.
2914 New in this release:
2916 * Security fix. An attacker on the local system could make you
2917 overwrite one of your own files with a single byte. The problem
2918 exist when you use --compress or --tmux or --pipe or --cat or
2919 --fifo. The attacker must figure out the randomly chosen file name
2920 and create a symlink within a time window of 15 ms.
2922 * --shuf will generate all jobs, and shuffle them before running
2923 them. This is useful to get a quick preview of the results before
2924 running the full batch.
2926 * GNU Parallel now has a DOI: https://dx.doi.org/10.5281/zenodo.16303
2928 * GNU Parallel was cited in: Scaling Machine Learning for Target
2929 Prediction in Drug Discovery using Apache Spark
2930 https://cris.cumulus.vub.ac.be/portal/files/5147244/spark.pdf
2932 * GNU Parallel was cited in: Bayesian inference of protein structure
2933 from chemical shift data https://peerj.com/articles/861/
2935 * GNU Parallel was cited in: Toward Enhanced Metadata Quality of
2936 Large-Scale Digital Libraries: Estimating Volume Time Range
2937 https://www.ideals.illinois.edu/bitstream/handle/2142/73656/186_ready.pdf
2939 * GNU Parallel was cited in: Experimental study on the Wind Farm
2940 Substation Cable Installation Problem
2941 http://i11www.iti.uni-karlsruhe.de/_media/teaching/theses/ma-schmitz-14.pdf
2943 * GNU Parallel was used in: https://github.com/KAPPS-/landsat-gifworks
2945 * GNU Parallel was used in: https://github.com/exascience/elprep
2947 * GNU Parallel was used in:
2948 http://search.cpan.org/~jillrowe/HPC-Runner-GnuParallel-0.01/
2950 * GNU Parallel was used in:
2951 http://search.cpan.org/~ajpage/Bio-Roary-2.0.7/lib/Bio/Roary/JobRunner/Parallel.pm
2953 * GNU Parallel was used in: Rapid haploid SNP calling
2954 https://github.com/tseemann/snippy
2956 * Pictures and Metadata
2957 http://www.ozzy.no/2015/02/05/pictures-and-metadata/
2959 * Task automation with bash and parallel
2960 https://biowize.wordpress.com/2015/03/23/task-automation-with-bash-and-parallel/
2962 * How To: Speed Up File Transfers in Linux using RSync with GNU
2964 http://www.yourownlinux.com/2015/04/speed-up-file-transfers-using-rsync-with-gnu-parallel.html
2966 * Mirroring a Git Repository
2967 https://avacariu.me/articles/mirroring-a-git-repository.html
2969 * Add an ENVI header to JAXA Global Mangrove Watch PALSAR tiles
2970 https://spectraldifferences.wordpress.com/2015/03/24/add-an-envi-header-to-jaxa-global-mangrove-watch-palsar-tiles/
2973 http://www.zhihu.com/question/29257300
2975 * Bug fixes and man page updates.
2980 New in this release:
2982 * --number-of-cores respects 'taskset' on GNU/Linux.
2984 * --joblog --pipe gives the data send and received in the log.
2986 * GNU Parallel was tested to support 100 GB sized records in --pipe. A
2987 few bugs was fixed to support >2 GB records. It works, but is rather
2990 * GNU Parallel was cited in: RIG: Recalibration and Interrelation of
2991 genomic sequence data with the GATK
2992 http://www.g3journal.org/content/early/2015/02/13/g3.115.017012.full.pdf+html
2994 * GNU Parallel was cited in: MPI-blastn and NCBI-TaxCollector:
2995 Improving metagenomic analysis with high performance classification
2996 and wide taxonomic attachment
2997 http://www.worldscientific.com/doi/abs/10.1142/S0219720014500139?af=R&
2999 * GNU Parallel was cited in: Recent evolution in Rattus norvegicus is
3000 shaped by declining effective population size
3001 http://biorxiv.org/content/biorxiv/early/2015/03/01/015818.full.pdf
3003 * GNU Parallel was cited in: Evidence for DCO+ as a probe of
3004 ionization in the warm disk surface
3005 http://arxiv.org/pdf/1503.02659.pdf
3007 * GNU Parallel was cited in: De novo assembly and annotation of the
3008 Asian tiger mosquito (Aedes albopictus) repeatome with dnaPipeTE
3009 from raw genomic reads and comparative analysis with the yellow
3010 fever mosquito (Aedes aegypti)
3011 http://gbe.oxfordjournals.org/content/early/2015/03/11/gbe.evv050.full.pdf
3013 * GNU Parallel was cited in: A General Approach to Network
3014 Configuration Analysis
3015 http://research.microsoft.com/en-us/um/people/ratul/papers/nsdi2015-batfish.pdf
3017 * GNU Parallel was cited in: Scrimer: designing primers from
3019 http://onlinelibrary.wiley.com/doi/10.1111/1755-0998.12403/pdf
3021 * GNU Parallel was cited in: Efficient Retrieval of Key Material for
3022 Inspecting Potentially Malicious Traffic in the Cloud
3023 http://sacko.uk/pdf/2015.1.pdf
3025 * GNU Parallel will be presented at Strataconf: Poor Man's Parallel
3027 http://strataconf.com/big-data-conference-uk-2015/public/schedule/detail/40031
3029 * GNU Parallel was used in:
3030 https://github.com/alexbyrnes/FCC-Political-Ads_The-Code
3032 * GNU Parallel was used in: https://github.com/martymac/fpart
3034 * GNU Parallel was used in:
3035 https://github.com/hoytak/diabetic-retinopathy-code
3037 * GNU Parallel was used in:
3038 https://github.com/mehmattski/HybSeqPipeline
3040 * GNU Parallel was used in:
3041 http://search.cpan.org/~ajpage/Bio-Roary-2.0.0/lib/Bio/Roary/JobRunner/Parallel.pm
3043 * Using GNU Parallel on a Raspberry Pi cluster:
3044 http://www.dcglug.org.uk/cluster-progress/
3046 * An introduction to vector tiling and map reduce in postgis:
3047 http://dimensionaledge.com/intro-vector-tiling-map-reduce-postgis/
3049 * Running scripts in parallel with GNU Parallel:
3050 http://code.jasonbhill.com/2015/03/
3052 * Mahout: Parallelising the creation of DecisionTrees:
3053 http://www.markhneedham.com/blog/2012/12/27/mahout-parallelising-the-creation-of-decisiontrees/
3055 * High-Performance Scientific Computing: Running serial jobs in
3057 https://support.scinet.utoronto.ca/education/staticpublic/course178/serial.pdf
3059 * Parallel cardinality on your laptop
3060 https://highonscience.wordpress.com/2015/03/15/parallel-cardinality-on-your-laptop/
3062 * Experiments about a better locate using grep
3063 http://a3nm.net/blog/better_locate.html
3065 * Homework with GNU Parallel:
3066 https://support.scinet.utoronto.ca/education/staticpublic/course178content349.html
3068 * Parallel - Jobs in Skripten parallelisieren:
3069 https://slzm.de/blog/linux-tool-des-tages-parallel-jobs-in-skripten-parallelisieren/#more-612
3071 * GNU Parallel, czyli 100% użycia procesora
3072 http://matmatyk.blogspot.dk/2015/03/gnu-parallel-czyli-100-uzycia-procesora.html
3074 * Bug fixes and man page updates.
3079 * --tmux has gotten a major overhaul.
3081 * GNU Parallel was cited in: RaftLib: A C++ Template Library for High
3082 Performance Stream Parallel Processing
3083 http://www.cs.wustl.edu/~lip/pubs/pmam15_jbeard.pdf
3085 * GNU Parallel was cited in: Quantifying properties of hot and dense
3086 QCD matter through systematic model-to-data comparison
3087 http://arxiv.org/pdf/1502.00339.pdf
3089 * GNU Parallel was cited in: Towards Collaborative Exploration and
3090 Analysis of Big Data from Mars: A Noachis Terra Case Study
3091 http://link.springer.com/chapter/10.1007/978-3-319-13865-7_25
3093 * GNU Parallel was used (unfortunately with wrong citation) in:
3094 Performance and Scaling Comparison Study of RDBMS and NoSQL
3096 http://ijact.in/wp-content/uploads/2014/11/COMPUSOFT-311-1270-1275.pdf
3098 * GNU Parallel was used (unfortunately without citation) in: Parallel
3099 Implementation of Big Data Pre-Processing Algorithms for Sentiment
3100 Analysis of Social Networking Data
3101 http://www.researchmathsci.org/IJFMAart/ijfma-v6n2-7.pdf
3103 * GNU Parallel was used (unfortunately without citation) in: SpeedSeq:
3104 Ultra-fast personal genome analysis and interpretation
3105 http://biorxiv.org/content/biorxiv/early/2014/12/05/012179.full.pdf
3107 * Zip Folders with GNU Parallel
3108 http://fazky.github.io/posts/Linux/2015-01-07-GNU-Parallel.html
3110 * Using GNU Parallel with Freesurfer
3111 http://programminginadarkroom.blogspot.dk/2015/02/using-gnu-parallel-with-freesurfer.html
3113 * GNU Parallel is used in Velociraptor: https://github.com/ericwhyne/Velociraptor
3115 * Marcus Beach GNU Parallel http://marcusbeach.co/gnu-parallel/
3117 * Bug fixes and man page updates.
3122 * Remote jobs now send stderr (standard error) to stderr (standard
3123 error) instead of stdout (standard output).
3125 * Remote execution command is now packed using base64 encoded
3126 bzip2. This means that big environments (app. 100 KB) can be
3127 transferred. This change makes remote execution alpha quality.
3129 * --semaphoretimeout now takes a negative value. This means give up if
3130 the semaphore is not gotten within the timeout.
3132 * --halt -1 and -2 now means halt if a job succeeds (so the opposite
3135 * --no-keep-order will reverse --keep-order.
3137 * Bash's second fix of shellshock caused --env to break again when
3138 exporting functions. This has been fixed again.
3140 * A semibig refactoring of big functions. All non-trivial functions
3141 are now less than 100 lines. The refactoring makes this release beta
3144 * A description of the design decisions for GNU Parallel can be found
3145 in 'man parallel_design'.
3147 * A bug fix in replacement strings caused rewrite of the replacement
3148 function. This makes use of replacement strings alpha quality.
3150 * GNU Parallel was cited in: Improving Energy and Performance with
3151 Spintronics Caches in Multicore Systems
3152 http://link.springer.com/chapter/10.1007/978-3-319-14313-2_24
3154 * GNU Parallel was cited in: Parallel post-processing with MPI-Bash
3155 http://dl.acm.org/citation.cfm?id=2691137
3157 * GNU Parallel was cited in: Distinguishing cause from effect using
3158 observational data: methods and benchmarks
3159 http://arxiv-web3.library.cornell.edu/pdf/1412.3773.pdf
3161 * GNU Parallel was cited in: Data Science at the Command Line
3162 http://cdn.oreillystatic.com/oreilly/booksamplers/9781491947852_sampler.pdf
3164 * GNU Parallel was cited in: Resolution of Genetic Map Expansion
3165 Caused by Excess Heterozygosity in Plant Recombinant Inbred
3166 Populations http://www.g3journal.org/content/4/10/1963.full.pdf
3168 * GNU Parallel was cited in: Bayesian Inference of Protein Structure
3169 from Chemical Shift Data https://peerj.com/preprints/692v1.pdf
3171 * GNU Parallel was cited in: Clonal interference and Mullerʼs ratchet
3172 in spatial habitats http://iopscience.iop.org/1478-3975/11/5/056003
3174 * GNU Parallel was cited in: Computação Verde na Camada de Aplicação
3175 https://linux.ime.usp.br/~tpaiva/mac0499/files/monografia.pdf
3177 * GNU Parallel was cited in: Frameshift alignment: statistics and
3178 post-genomic applications
3179 http://bioinformatics.oxfordjournals.org/content/30/24/3575.full.pdf+html
3181 * GNU Parallel was cited in: Towards Recommender Engineering Tools and
3182 Experiments for Identifying Recommender Differences
3183 http://elehack.net/research/thesis/mde-thesis.pdf
3185 * GNU Parallel was cited in: Speaker Environment Classification Using
3186 Rhythm Metrics in Levantine Arabic Dialect
3187 http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6923918
3189 * GNU Parallel was cited in: A Formal Proof Of The Kepler Conjecture
3190 http://arxiv.org/pdf/1501.02155.pdf
3192 * GNU Parallel was cited in: Allocation Policy Analysis for Cache
3193 Coherence Protocols for STT-MRAM-based caches
3194 http://conservancy.umn.edu/bitstream/handle/11299/169362/Nandkar_umn_0130M_15551.pdf
3196 * GNU Parallel was cited in: Using Trusted Platform Module for
3197 securing virtual environment access in Cloud
3198 http://dar.aucegypt.edu:8080/bitstream/handle/10526/4237/Using%20Trusted%20Platform%20Module%20for%20Securing%20Virtual%20Environment%20Access%20in%20Cloud.pdf
3200 * GNU Parallel was cited in: Weakly Supervised Learning for
3201 Compositional Sentiment Recognition
3202 http://computerlinguist.org/static/downloads/ma-thesis/Master_Thesis-Michael_Haas-Weakly_Supervised_Learning_for_Compositional_Sentiment_Recognition.pdf
3204 * GNU Parallel was cited in: Agility and Performance in Elastic
3205 Distributed Storage http://dl.acm.org/citation.cfm?id=2668129
3207 * GNU Parallel was used (unfortunately without citation) in: Large
3208 Scale Author Name Disambiguation in Digital Libraries
3209 http://semanticommunity.info/@api/deki/files/31523/P227_3546.pdf
3211 * GNU Parallel is used in BEDOPS:
3212 https://media.readthedocs.org/pdf/bedops/v2p5p0/bedops.pdf
3214 * Job ad asking for GNU Parallel skills:
3215 http://www.aplitrak.com/?adid=dXMzMTYxMjQuMzg0MTkuMTU1MEBtYW5wb3dlcmZveG5hLmFwbGl0cmFrLmNvbQ#sthash.kYCIhhty.KcoT6HnJ.dpbs
3217 * GNU Parallel: Open Source For You (OSFY) magazine, October 2013
3219 http://www.shakthimaan.com/posts/2014/11/27/gnu-parallel/news.html
3221 * Multithreaded Encryption and Compression
3222 http://www.krazyworks.com/multithreaded-encryption-and-compression/
3224 * GNU Parallel on OSX and Linux
3225 https://darknightelf.wordpress.com/2015/01/01/gnu-parallel-on-osx/
3227 * How to build gnu parallel from source on Ubuntu PC?
3228 http://blog.ovidiuparvu.com/build-gnu-parallel-source-ubuntu-pc/
3230 * GNU parallel for openaddr-process-one
3231 https://nelsonslog.wordpress.com/2015/01/09/gnu-parallel-for-openaddr-process-one/
3233 * From SRA Project to FastQ http://danielecook.com/sra-project-fastq/
3235 * Software Development Tooling
3236 http://www.computer.org/csdl/mags/so/2014/06/mso2014060021.pdf
3238 * コマンドを並列に実行するGNU parallelがとても便利
3239 http://bicycle1885.hatenablog.com/entry/2014/08/10/143612
3241 * Bug fixes and man page updates.
3246 * Remote systems can be divided into hostgroups (e.g. web and db) by
3247 prepending '@groupname/' to the sshlogin. Multiple groups can be
3248 given by separating groups with '+'. E.g. @web/www1 @web+db/www2
3251 * Remote execution can be restricted to servers that are part of one
3252 or more groups by '@groupname' as an sshlogin. Multiple groups can
3253 be given by separating groups with '+'. E.g. -S @web or -S @db+web
3255 * With --hostgroup you can restrict arguments to certain hostgroups by
3256 appending '@groupname' to the argument. Multiple groups can be
3257 given by separating groups with '+'. E.g. my_web_arg@web
3258 db-or-web-arg@db+web db-only-arg@db Thanks to Michel Courtine for
3259 developing a prototype for this.
3261 * GNU Parallel was cited in: HTSeq-Hadoop: Extending HTSeq for
3262 Massively Parallel Sequencing Data Analysis using Hadoop
3263 http://essenceofescience.se/wp-content/uploads/2014/11/Siretskiy.pdf
3265 * GNU Parallel was cited in: SlideToolkit: An Assistive Toolset for
3266 the Histological Quantification of Whole Slide Images
3267 http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0110289
3269 * GNU Parallel was cited in: Exploring a multiprocessor design space
3270 to analyze the impact of using STT-RAM in the memory hierarchy
3271 http://conservancy.umn.edu/bitstream/handle/11299/167286/Borse_umn_0130M_15431.pdf
3273 * Command-Line OCR with Tesseract on Mac OS X
3274 https://ryanfb.github.io/etc/2014/11/13/command_line_ocr_on_mac_os_x.html
3276 * Bug fixes and man page updates.
3281 * --env was changed to deal with Bash's new way of exporting a function.
3283 * GNU Parallel was cited in: Exclusion of cosmic rays in
3284 protoplanetary disks. II. Chemical gradients and observational
3285 signatures http://iopscience.iop.org/0004-637X/794/2/123/article
3287 * GNU Parallel was cited in: Application of Machine Learning to
3288 Algorithm Selection for TSP
3289 http://www.dbai.tuwien.ac.at/staff/musliu/art_ictai_cam.pdf
3291 * GNU Parallel was cited in: Performance Models for LTE-Advanced
3293 http://repository.asu.edu/attachments/137242/content/Tyagi_asu_0010E_14116.pdf
3295 * GNU Parallel was used (unfortunately without citation) in: De Novo
3296 Insertions and Deletions of Predominantly Paternal Origin Are
3297 Associated with Autism Spectrum Disorder
3298 http://www.cell.com/cms/attachment/2019079667/2039310868/mmc1.pdf
3300 * GNU Parallel was determined 'popular' by Statistical Analysis of
3301 Popular Open Source Software Projects and Their Communities
3302 http://andiwre.itmaranatha.org/prosiding/ICITEE2014/PaperAndiWRE-ICITEE2014.pdf
3304 * GNU Parallel is demonstrated in: Data Science at the Command Line:
3305 Facing the Future with Time-Tested Tools
3307 * GNU Parallel was covered in a talk at Sydney Perl Mongers group
3308 http://www.openfusion.net/talks/pwp/#24
3310 * GNU Parallel and how to get started with it
3311 http://www.jduck.net/blog/2014/09/30/gnu-paralell/
3313 * Behat/Selenium/Parallel
3314 http://jaffamonkey.com/behat-selenium-parallel/
3316 * Comparing Golang, Scala, Elixir and Ruby for ETL
3317 http://www.dimroc.com/2014/09/29/etl-language-showdown/
3319 * Assemble a list of which of these hosts are up or down
3320 http://opsfun.wordpress.com/2014/03/31/gnu-parallel/
3322 * Running commands on many nodes simultaneously
3323 http://opsfun.wordpress.com/2014/03/31/19/
3325 * Ubuntu 13.04でGNU ParallelをGNUモードで動かす
3326 http://qiita.com/YusukeSuzuki@github/items/7b96b5876bf980f21e85
3328 * Bug fixes and man page updates.
3333 * If the file given as --sshloginfile is changed it will be re-read
3334 when a job finishes though at most once per second. This makes it
3335 possible to add and remove hosts while running.
3337 * Brutha uses GNU Parallel https://pypi.python.org/pypi/brutha/1.0.2
3339 * OCRmyPDF uses GNU Parallel https://github.com/fritz-hh/OCRmyPDF/
3341 * GNU Parallel was presented at Balti and Bioinformatics "On-Air"
3342 http://youtu.be/UtXlr19xTh8?t=2h5m0s
3344 * Pleiades Plus uses GNU Parallel
3345 https://github.com/ryanfb/pleiades-plus
3347 * Imagemagick and GNU Parallel
3348 http://deepdish.io/2014/09/15/gnu-parallel/
3350 * GNU Parallel (Sebuah Uji Coba)
3351 http://pr4ka5a.wordpress.com/2014/09/04/gnu-parallel-sebuah-uji-coba/
3353 * GNU Parallel: 并行执行Linux命令
3354 http://blog.csdn.net/xzz_hust/article/details/39183837
3359 * GNU Parallel now uses the same shell it was started from as the
3360 command shell for local jobs. So if GNU Parallel is started from
3361 tcsh it will use tcsh as its shell even if the login $SHELL is
3362 different. For remote jobs the login $SHELL will be used.
3364 * The whole current environment in bash can be copied by using a shell
3365 wrapper function (Search manual for env_parallel).
3367 * --plus adds the replacement strings {+/} {+.} {+..} {+...} {..}
3368 {...} {/..} {/...}. The idea being that '+foo' matches the opposite
3369 of 'foo' and {} = {+/}/{/} = {.}.{+.} = {+/}/{/.}.{+.} = {..}.{+..}
3370 = {+/}/{/..}.{+..} = {...}.{+...} = {+/}/{/...}.{+...}
3372 * GNU Parallel now deals correctly with the combination
3373 rsync-3.1.X-client and rsync-2.5.7-server
3375 * GNU Parallel was cited in: A Web Service for Scholarly Big Data
3376 Information Extraction
3377 http://patshih.ist.psu.edu/publications/Williams-CiteSeerExtractor-ICWS14.pdf
3379 * Comparison of the speed of different GNU Parallel versions:
3380 http://lists.gnu.org/archive/html/parallel/2014-08/msg00030.html
3382 * GNU Parallel was covered in the webcast 2014-08-20: Data Science at
3383 the Command Line http://www.oreilly.com/pub/e/3115
3385 * Distributed processing with GNU parallel
3386 http://kazjote.eu/2014/08/11/distributed-processing-with-gnu-parallel
3388 * A Peek into GNU Parallel
3389 http://blog.dataweave.in/post/94238943763/a-peek-into-gnu-parallel
3391 * Сборка GNU parallel для CentOS/RHEL
3392 http://www.stableit.ru/2014/07/gnu-parallel-centosrhel.html
3394 * Bug fixes and man page updates.
3399 * {= perl expression =} can be used as replacement string. The
3400 expression should modify $_. E.g. {= s/\.gz$// =} to remove .gz from
3401 the string. This makes replacement strings extremely flexible.
3403 * Positional perl expressions (similar to {2}) are given as {=2 perl
3404 expression=} where 2 is the position.
3406 * One small backwards incompatibility: {1}_{2} will replace {2} with
3407 the empty string if there is only one argument. Previously {2} would
3408 have been left untouched.
3410 * Replacement strings can be defined using --rpl. E.g. parallel --rpl
3411 '{.gz} s/\.gz$//' echo {.gz} ::: *.gz
3413 * The parenthesis around {= perl expression =} can be changed with
3416 * --tmux will direct the output to a tmux session instead of
3417 files. Each running jobs will be in its own window.
3419 * --halt 10% will stop spawning new jobs if 10% failed so far.
3421 * GNU Parallel was cited in: bammds: A tool for assessing the ancestry
3422 of low depth whole genome data using multidimensional scaling (MDS)
3423 http://bioinformatics.oxfordjournals.org/content/early/2014/06/28/bioinformatics.btu410.abstract
3425 * GNU Parallel was cited in: Molecular ferroelectric contributions to
3426 anomalous hysteresis in hybrid perovskite solar cells
3427 http://people.bath.ac.uk/aw558/publications/2014/arxiv_hysteresis_14.pdf
3429 * GNU Parallel was cited in: Energy Sorghum-a genetic model for the
3430 design of C4 grass bioenergy crops
3431 http://jxb.oxfordjournals.org/content/early/2014/06/20/jxb.eru229.short
3433 * GNU Parallel was cited in: Web-scale Content Reuse Detection
3434 www.isi.edu/~johnh/PAPERS/Ardi14a.pdf
3436 * Tell your friends to sign up for the Webcast at 2014-08-20 covering
3437 GNU Parallel: Data Science at the Command Line
3438 http://www.oreilly.com/pub/e/3115
3440 * GNU Parallel all the things!
3441 http://longwayaround.org.uk/notes/gnu-parallel-all-the-things/
3443 * Shell command composition and dispatch
3444 http://lukeluo.blogspot.dk/2014/07/linux-virtual-console6-shell-command.html
3446 * Parallelising plink (or anything else) the easy way
3447 http://chrisladroue.com/2012/03/parallelising-plink-or-anything-else-the-easy-way/
3449 * Easy and cheap cluster building on AWS
3450 https://grapeot.me/easy-and-cheap-cluster-building-on-aws.html
3452 * Paralelizace běžných činností v konzoli pomocí GNU Parallel
3453 http://www.abclinuxu.cz/clanky/paralelizace-beznych-cinnosti-v-konzoli-pomoci-gnu-parallel
3455 * [原] Ubuntu 下使用 parallel 命令的注意事项
3456 http://blog.ailms.me/2014/06/28/ubuntu-with-parallel.html
3458 * 简单的并行, 可使用GNU parallel
3459 http://jerkwin.github.io/2014/06/10/GNU-parallel/
3461 * Bug fixes and man page updates.
3466 * --shebang and --shebang-wrap now works on FreeBSD.
3468 * --pipepart works with --header, --regexp, --cat and --fifo.
3470 * ./configure --disable-documentation will not build documentation.
3472 * {%} works as job slot.
3474 * GNU Parallel was cited in: Energy Efficient, High-speed
3475 Communication in WSNs
3476 https://gupea.ub.gu.se/bitstream/2077/35801/1/gupea_2077_35801_1.pdf
3478 * GNU Parallel was cited in: Ferroelectric contributions to anomalous
3479 hysteresis in hybrid perovskite solar cells
3480 http://arxiv.org/pdf/1405.5810.pdf
3482 * Processes Paralleling to Speed up Computing and Tasks Execution in
3484 http://kukuruku.co/hub/nix/processes-paralleling-to-speed-up-computing-and-tasks-execution-in-linux
3486 * Moving / Copying lots of s3 files quickly using gnu parallel
3487 http://blog.aclarke.eu/moving-copying-lots-of-s3-files-quickly-using-gnu-parallel/
3489 * Speeding up grep log queries with GNU Parallel
3490 http://www.tripwire.com/state-of-security/incident-detection/speeding-grep-queries-gnu-parallel/
3492 * Ubuntu - Gnu parallel - It's awesome
3493 http://kasunweranga.blogspot.dk/2014/06/ubuntu-gnu-parallel-its-awesome.html
3495 * Export quicklooks with vector overlay using TuiView
3496 http://spectraldifferences.wordpress.com/2014/03/08/export-quicklooks-with-vector-overlay-using-tuiview/
3498 * GNU Parallel指南 http://my.oschina.net/enyo/blog/271612
3500 * GNU parallelで違和感 http://jarp.does.notwork.org/diary/201405c.html#201405301
3502 * Bug fixes and man page updates.
3507 * Use --semaphoretimeout to ignore the semaphore lock after a while.
3509 * {%} introduced as job slot replacement string. It has known bugs.
3511 * --slotreplace changes slot replacement string.
3513 * GNU Parallel officially in Solaris 11.2beta
3514 https://blogs.oracle.com/alanc/entry/solaris_11_2_changes_to
3516 * GNU Parallel was cited in: A Comparison of Antenna Placement
3517 Algorithms http://abhinavjauhri.com/publications/eap.pdf
3519 * Using GNU Parallel on a PBS cluster (nice use of --shebang-wrap)
3520 https://docs.it4i.cz/anselm-cluster-documentation/resource-allocation-and-job-execution/capacity-computing
3522 * BioLite uses GNU Parallel: https://bitbucket.org/caseywdunn/biolite
3524 * Isitdown uses GNU Parallel: http://www.isi.edu/~calvin/isitdown.md
3526 * Convert FLAC to MP3 with GNU parallel
3527 http://www.blogobramje.nl/posts/Convert_FLAC_to_MP3_with_GNU_parallel/
3529 * JD Edwards Business Function Documentation
3530 http://www.azertech.net/content/jd-edwards-business-function-documentation
3532 * Tools of the trade http://blog.eikeland.se/2014/05/01/tools-of-the-trade/
3534 * How I start a bioinformatics project
3535 http://nickloman.github.io/2014/05/14/how-i-start-a-bioinformatics-project/
3537 * No:The-Me GNU Parallel http://adityalaghate.in/gnu-parallel.html
3539 * Bug fixes and man page updates.
3544 * --pipepart is a highly efficient alternative to --pipe if the input
3545 is a real file and not a pipe.
3547 * If using --cat or --fifo with --pipe the {} in the command will be
3548 replaced with the name of a physical file and a fifo respectively
3549 containing the block from --pipe. Useful for commands that cannot
3550 read from standard input (stdin).
3552 * --controlmaster has gotten an overhaul and is no longer
3555 * --env is now copied when determining CPUs on remote system. Useful
3556 for copying $PATH if parallel is not in the normal path.
3558 * --results now chops the argument if the argument is longer than the
3559 allowed path length.
3561 * Build now survives if pod2* are not installed.
3563 * The git repository now contains tags of releases.
3565 * GNU Parallel was cited in: Proactive System for Digital Forensic
3567 http://dspace.library.uvic.ca:8080/bitstream/handle/1828/5237/Alharbi_Soltan_PhD_2014.pdf
3569 * GNU Parallel was cited in: Beyond MAP estimation with the
3570 track-oriented multiple hypothesis tracker
3571 http://ieeexplore.ieee.org/xpl/abstractReferences.jsp?tp=&arnumber=6766651&url=http%3A%2F%2Fieeexplore.ieee.org%2Fxpls%2Fabs_all.jsp%3Farnumber%3D6766651
3573 * GNU Parallel was cited in: Prokka: rapid prokaryotic genome
3575 http://bioinformatics.oxfordjournals.org/content/early/2014/03/18/bioinformatics.btu153.short
3577 * GNU Parallel was used (unfortunately with improper citation) in:
3578 Perspectives in magnetic resonance: NMR in the post-FFT era
3579 http://www.sciencedirect.com/science/article/pii/S1090780713003054
3581 * GNU Parallel is used in https://github.com/cc2qe/speedseq
3583 * Batch XML validation at the command line.
3584 http://horothesia.blogspot.dk/2014/04/batch-xml-validation-at-command-line.html
3586 * freebayes-parallel uses GNU Parallel
3587 https://github.com/ekg/freebayes/commit/31ee997984cebe8a196381c3de57e618e34a2281
3589 * Org-mode with Parallel Babel http://draketo.de/english/emacs/parallel-babel#sec-2
3591 * Speeding Up Grep Log Queries with GNU Parallel
3592 http://www.cybersecurity.io/speeding-grep-queries-gnu-parallel/
3594 * How to run tbss_2_reg in parallel
3595 http://tadpolebrainimaging.blogspot.dk/2014/03/how-to-run-tbss2reg-in-parallel.html
3597 * GNU parallel example: blastn https://asciinema.org/a/8775
3599 * Iterative DNS Brute Forcing
3600 http://www.room362.com/blog/2014/02/19/iterative-dns-brute-forcing/
3602 * Ejecutando comandos en paralelo
3603 http://jesusmercado.com/guias/ejecutando-comandos-en-paralelo/
3605 * Ejecutando en paralelo en bash (ejemplo con rsync)
3606 http://eithel-inside.blogspot.dk/2014/04/ejecutando-en-paralelo-en-bash-ejemplo.html
3608 * Bug fixes and man page updates.
3613 * Offical package for Alpine Linux now exists:
3614 http://alpinelinux.org/apk/main/x86/parallel
3616 * GNU Parallel was cited in: Estimating uncertainties in statistics
3617 computed from direct numerical simulation
3618 http://dx.doi.org/10.1063/1.4866813
3620 * GNU Parallel was cited in: Vehicle routing problems with time
3621 windows and multiple service workers: a systematic comparison
3622 between ACO and GRASP
3623 http://link.springer.com/article/10.1007/s10100-014-0341-z
3625 * GNU Parallel, quick and easy
3626 http://www.reganmian.net/blog/2014/03/09/gnu-parallel-quick-and-easy/
3628 * Using Multiple CPU Cores With Command Line Tools
3629 http://prateekvjoshi.com/2014/03/07/using-multiple-cpu-cores-with-command-line-tools/
3631 * Batch convert mp3 CBR to VBR
3632 http://blogs.zercle.com/bouroo/2013/03/batch-convert-mp3-cbr-to-vbr/
3634 * Running Behat in parallel with Selenium grid
3635 http://zalas.eu/running-behat-in-parallel-with-selenium-grid/
3637 * Git-Mirror per cronjob aktuell halten
3638 https://www.schtobia.de/2013/git-mirror-per-cronjob-aktuell-halten/
3640 * Пишем многопоточный скрипт на bash
3641 http://dafter.ru/duf/howto/130.html
3643 * 如何利用多核CPU来加速你的Linux命令
3644 http://www.chinadmd.com/file/xpcr6wpctzwtuu3ivwiaatcs_1.html
3646 * Bug fixes and man page updates.
3651 * --tollef has been retired.
3653 * --compress has be redesigned due to bugs.
3655 * Format of --eta and --joblog has changed slightly.
3657 * GNU Parallel was cited in: Speaker Verification and Keyword Spotting
3658 Systems for Forensic Applications
3659 http://lantana.tenet.res.in/website_files/thesis/Phd/srikanth.pdf
3661 * GNU Parallel was cited in: Scaleable Code Clone Detection
3662 http://scg.unibe.ch/archive/phd/schwarz-phd.pdf
3664 * GNU Parallel was cited in: Clone Detection that scales
3665 http://scg.unibe.ch/archive/masters/Vogt14a.pdf
3667 * GNU Parallel was cited in: Scalable Positional Analysis for Studying
3668 Evolution of Nodes in Networks
3669 http://arxiv-web3.library.cornell.edu/pdf/1402.3797
3671 * GNU Parallel was cited in: Aggregate Characterization of User
3672 Behavior in Twitter and Analysis of the Retweet Graph
3673 http://arxiv.org/pdf/1402.2671v1
3675 * GNU Parallel was used (unfortunately without citation) in: Causal
3676 Network Models for Predicting Compound Targets and Driving Pathways
3678 http://jbx.sagepub.com/content/early/2014/02/10/1087057114522690.full
3680 * GNU Parallel was used (unfortunately without citation) in:
3681 Performance and Energy Efficiency of Common Compression /
3682 Decompression Utilities
3683 http://www.researchgate.net/publication/243962643_Performance_and_Energy_Efficiency_of_Common_CompressionDecompression_Utilities_An_Experimental_Study_in_Mobile_and_Workstation_Computer_Platforms/file/3deec51d1dbc0474f9.pdf
3685 * GNU Parallel was used (unfortunately without citation) in: SpringFS:
3686 Bridging Agility and Performance in Elastic Distributed Storage
3687 http://www.istc-cc.cmu.edu/publications/papers/2014/SpringFS-FAST14.pdf
3689 * GNU Parallel was recommended (without citation) in: Redesigning the
3690 Specificity of Protein-DNA Interactions with Rosetta
3691 http://link.springer.com/protocol/10.1007/978-1-62703-968-0_17
3693 * GNU Parallel is co-distributed with RepeatExplorer
3694 http://www.vcru.wisc.edu/simonlab/bioinformatics/programs/repeatexplorer/README.txt
3696 * Convert MP3 to a scrolling spectrum waterfall plot video
3697 http://jdesbonnet.blogspot.dk/2014/02/convert-mp3-to-scrolling-spectrum.html
3699 * PHP wrapper class for the GNU Parallel tool
3700 https://github.com/geopal-solutions/gnu-parallel-wrapper/tree/master
3702 * Exploratory Data Analysis http://www.slideshare.net/thinrhino/gnunify
3704 * Copias de archivos con rsync y parallel
3705 http://linuxmanr4.com/2014/02/20/copias-de-archivos-con-rsync-y-parallel
3707 * Single-Thread-Programme auf Multicore-Rechnern parallelisieren
3708 http://www.adlerweb.info/blog/2014/02/08/linux-single-thread-programme-auf-multicore-rechnern-parallelisieren
3710 * Распараллеливаем процессы для ускорения вычислений и выполнения
3711 заданий в Linux http://savepearlharbor.com/?p=210480
3713 * Bug fixes and man page updates.
3718 * GNU Parallel was cited in: On the likelihood of multiple bit upsets
3720 http://arxiv-web3.library.cornell.edu/pdf/1401.1003
3722 * HaploClique uses GNU Parallel
3723 https://github.com/armintoepfer/haploclique
3725 * Scraping NSScreencast
3726 https://blog.nicolai86.eu/posts/2014-01-12/scraping-nsscreencast/
3728 * 30 Cool Open Source Software I Discovered in 2013
3729 http://www.cyberciti.biz/open-source/30-cool-best-open-source-softwares-of-2013/
3731 * [Unix] 13. The power of doing things in Parallel
3732 http://leetaey.tistory.com/384
3734 * Parallel the execution of a job that read from stdin
3735 http://www.linuxask.com/questions/parallel-the-execution-of-a-job-that-read-from-stdin
3737 * Mon Make à moi (6:38-11:50)
3738 http://videos.rennes.inria.fr/ReNaBI-GO2013/indexPierreLindenbaum.html
3740 * Shell-Abarbeitung beschleunigen: Wie Sie mit parallelen Prozesse
3741 effizienter in der Shell arbeiten
3742 https://www.hosteurope.ch/blog/shell-abarbeitung-beschleunigen-wie-sie-mit-parallelen-prozesse-effizienter-in-der-shell-arbeiten/
3744 * Summary of GNU Parallel tutorial
3745 http://hacktracking.blogspot.dk/2014/01/gnu-parallel-tutorial.html
3747 * Bug fixes and man page updates.
3752 * GNU Parallel now has a motto: For people who live life in the
3755 * Detect if the buffer dir $TMPDIR runs out of space. This changes a
3756 central piece of code, making this release alpha quality.
3758 * --keep-order --(n)onall will sort according to the sshlogin.
3760 * Detect the number of CPUs on DEC Tru64.
3762 * GNU sql: --list-tables for sqlite3.
3764 * GNU Parallel was cited in: Variational Message-Passing: Extension to
3765 Continuous Variables and Applications in Multi-Target Tracking
3766 http://www.ics.uci.edu/~ajfrank/pubs/thesis.pdf
3768 * GNU Parallel was cited in: Genome Assembly: Scaffolding Guided by
3770 https://www.duo.uio.no/handle/10852/37431
3772 * GNU Parallel was cited in: Metagenomic analysis of Mariana Trench
3774 http://repositorio.ul.pt/handle/10451/9436
3776 * GNU Parallel was cited in: Diacritization, automatic segmentation
3777 and labeling for Levantine Arabic speech
3778 http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=6642556
3780 * GNU Parallel was cited in: Investigation of emotion classification
3781 using speech rhythm metrics
3782 http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=6642591
3784 * GNU Parallel was cited in: A Rhythm-Based Analysis of Arabic Native
3785 and Non-Native Speaking Styles
3786 http://www.ijsps.com/uploadfile/2013/1128/20131128014413279.pdf
3788 * GNU Parallel was cited in: Evolutionary optimization of wetlands
3790 http://dl.acm.org/citation.cfm?id=2480400
3792 * GNU Parallel was cited (unfortunately with wrong citation) in:
3793 RDBMS vs NoSQL: Performance and Scaling Comparison
3794 http://www.epcc.ed.ac.uk/sites/default/files/Dissertations/2012-2013/RDBMS%20vs%20NoSQL%20-%20Performance%20and%20Scaling%20Comparison.pdf
3796 * GNU Parallel was used (without proper citation) in: Comprehensive
3797 Analysis Pipeline for Discovery of Human Genetic Variation
3798 http://www.google.com/patents/US20130311106
3800 * Encrypt and decrypt in parallel with GPG
3801 http://blog.tkassembled.com/412/encrypt-and-decrypt-in-parallel-with-gpg/
3803 * Using GNU Parallel to create a SVM classifier
3804 http://ivanyu.me/blog/2013/12/01/parallel/
3806 * Parallel xz compression
3807 http://anthon.home.xs4all.nl/rants/2013/parallel_xz/
3809 * Got CPUs to burn? Put 'em to work with GNU parallel
3810 http://baoilleach.blogspot.dk/2013/11/got-cpus-to-burn-put-em-to-work-with.html
3813 http://pastebin.com/JmnB9ffq
3815 * Gnu Parallel for fun and profit
3816 https://gist.github.com/celoyd/f7eb55ad69c9b33fd8c3
3818 * Parallelization of Exploitation
3819 http://rantsideasstuff.com/parallelization-of-exploitation/
3821 * Running assemblies in parallel
3822 https://khmer-protocols.readthedocs.org/en/v0.8.3/metagenomics/4-assemble.html
3824 * Procesando la contabilidad del PP
3825 http://www.neorazorx.com/2013/07/procesando-la-contabilidad-del-pp.html
3827 * Mon make à moi (French)
3828 http://www.slideshare.net/lindenb/mon-make-moi-tout-sauf-galaxy
3830 * Bug fixes and man page updates.
3835 * A citation notice is printed on stderr only if stderr is a terminal,
3836 the user has not specified --no-notice and the user has not run
3837 --bibtex once. This makes the release alpha quality.
3839 * --compress will compress temporary files. If the output is big and
3840 very compressible this will take up less disk space in $TMPDIR and
3841 possibly be faster due to less disk I/O.
3843 * --compress-program comtrols which program to use for compressing
3846 * --bar show progress as a progress bar compatible with zenity.
3848 * --resume can now be used with --result: Jobs already run will be
3851 * --transfer and --basefile support paths relative to the --workdir by
3852 inserting /./ into the path.
3854 * GNU Parallel was cited in: fastphylo: Fast tools for phylogenetics
3855 http://www.biomedcentral.com/1471-2105/14/334/abstract
3857 * Using GNU parallel
3858 http://davetang.org/muse/2013/11/18/using-gnu-parallel/
3860 * Techlux - GNU - Parallel (German)
3861 https://techlux.de/blog/2013/11/07/gnu-parallel/
3863 * awk, sed, bzip2, grep, wc на всех ядрах
3864 http://vk.com/page-30666517_45528467
3866 * 如何利用多核CPU來加速你的Linux命令 — awk, sed, bzip2, grep, wc等
3867 http://www.hksilicon.com/kb/articles/290543/CPULinuxawk-sed-bzip2-grep-wc
3869 * GNU Parallel (Japanese)
3870 http://jarp.does.notwork.org/diary/201311b.html#20131117
3872 * Bug fixes and man page updates.
3877 * --transfer files with /./ in the path will copy the files relative
3880 * The maximal command length is now cached in a file halfing the
3883 * GNU Parallel was cited in: Investigating speaker gender using rhythm
3884 metrics in Arabic dialects
3885 http://ieeexplore.ieee.org/xpl/login.jsp?tp=&arnumber=6602389
3887 * GNU Parallel was cited in: Tiedon erist ̈minen ja visualisointi a
3888 lastensuojelun asiakaskertomuksista
3889 https://tampub.uta.fi/handle/10024/84978
3891 * Some Additional Useful Bioinformatics Software
3892 http://nix-bio.blogspot.dk/2013/10/additional-software-for-bioinformatics.html
3894 * GNU Parallel Example Screen Cast (bil to Geotiff conversion)
3895 http://www.youtube.com/watch?v=PpF27eC7Mys
3897 * Using GNU Parallel to roll-your-own Map Reduce!
3898 http://www.rankfocus.com/hello-world/
3900 * Use multiple CPU Cores with your Linux commands
3901 http://www.rankfocus.com/use-cpu-cores-linux-commands/
3903 * Using GNU Parallel at HPC @ Uni.lu
3904 https://hpc.uni.lu/users/use_cases/
3906 * Scaling up with parallelization
3907 https://www.msi.umn.edu/sites/default/files/AdvPython_1.pdf
3909 * How to teach yourself to be a technical tester
3910 http://infiniteundo.com/post/62421363463/qa-toc
3912 * Faster Rasters For All
3913 http://2013.foss4g.org/conf/programme/presentations/52/
3915 * Optimizing translated file downloads
3916 http://www.smartling.com/blog/2013/05/20/optimizing-translated-file-downloads/
3918 * EMC NetWorker parallel saveset cloning with nsrclone and GNU parallel
3919 http://www.beebotech.com.au/2013/10/emc-networker-parallel-saveset-cloning-with-nsrclone-and-gnu-parallel/
3921 * Best Practices for Amazon EMR
3922 http://media.amazonwebservices.com/AWS_Amazon_EMR_Best_Practices.pdf
3924 * Computing checksums for backup
3925 https://identi.ca/evan/note/6yf1GzAARtyBhj__xzMvAg
3927 * Un exemplu de utilizare a programului GNU parallel
3928 http://vundicind.blogspot.dk/2013/10/exemplu-utilizare-gnu-parallel.html
3931 http://www.slideshare.net/drakeguan/part1-23705978
3933 * なんか気持ちよかです Gnu Parallel
3934 http://a3-lab.jpn.org/note/%E3%81%AA%E3%82%93%E3%81%8B%E6%B0%97%E6%8C%81%E3%81%A1%E3%82%88%E3%81%8B%E3%81%A7%E3%81%99-gnu-parallel
3936 * Bug fixes and man page updates.
3941 * PDF-files of documentation is now included.
3943 * Cloning at warp speed 100 VMs in 1 minute using one command line
3944 http://www.beebotech.com.au/tag/command-line/
3946 * Calcul Quebec's introduction to GNU Parallel
3947 https://wiki.calculquebec.ca/w/GNU_parallel
3949 * Brincando com o GNU parallel
3950 http://blog.tadeucruz.com/2013/09/brincando-com-o-gnu-parallel/
3952 * GNU Parallelで並列処理を行う
3953 http://qiita.com/PENGUINANA_/items/af27a833e835fe17f09b
3955 * Bug fixes and man page updates.
3960 * A tutorial showing much of GNU Parallel's functionality. Spend an
3961 hour walking through the tutorial. Your commandline will love you
3962 for it. man parallel_tutorial
3964 * --line-buffer will buffer output on line basis. --group keeps the
3965 output together for a whole job. --ungroup allows output to mixup
3966 with half a line coming from one job and half a line coming from
3967 another job. --line-buffer fits between these two; it prints a full
3968 line, but will allow for mixing lines of different jobs.
3970 * --record-env records all variables and functions set. Useful to
3971 record the normal environment before using --env _.
3973 * --env _ exports all functions and variables to the remote server
3974 except for the ones recorded.
3976 * New signing key. Due to recommendations from NIST
3977 http://www.keylength.com/en/4/ the signing key was changed from
3978 1024D/ID:FFFFFFF1 to 9888R/ID:88888888.
3980 * Agalma: an automated phylogenomics workflow
3981 http://arxiv.org/pdf/1307.6432
3983 * Job ad asking for GNU Parallel expertise
3984 http://seattle.craigslist.org/est/sof/4006079352.html
3986 * Transient Beowulf Clustering with GNU Parallel and SSHfs
3987 http://www.reddit.com/r/linux/comments/1ka8mn/transient_beowulf_clustering_with_gnu_parallel/
3989 * Aligning to unique regions
3990 http://davetang.org/muse/2013/07/22/aligning-to-unique-regions/
3992 * Top 10 scripting tricks for basic bioinformatics
3993 http://students.washington.edu/bowmanjs/wordpress/?p=873
3995 * Using GNU Parallel to speed up and simplify data analyzes
3996 http://www.sergeymarkov.com/blog/2013/07/using-gnu-parallel-to-speed-up-and-simplify-data-analyzes/
3998 * Compression of files in parallel using GNU parallel
3999 http://codextechnicanum.blogspot.dk/2013/07/compression-of-files-in-parallel-using.html
4001 * Using GNU Parallel with Amazon
4002 media.amazonwebservices.com/AWS_Amazon_EMR_Best_Practices.pdf
4004 * Some useful comments on GNU Parallel
4005 https://news.ycombinator.com/item?id=6209767
4007 * Using GNU Parallel to count reads mapping to genes for multiple BAMs
4008 http://drduanehassane.com/blog/sequencing-resources
4010 * TimeMachineっぽいバックアップスクリプト
4011 http://rio.tc/2013/07/timemachine-1.html
4013 * GNU ParallelでAndroid NDKの全バージョンを一括ダウンロード
4014 http://qiita.com/mazgi/items/b10bf0ff3da2045d19ab
4016 * Bug fixes and man page updates.
4021 * --round-robin with --pipe will write all blocks to already running
4024 * --env can now transfer Bash function for remote execution. That is
4027 * GNU Parallel was used (unfortunately with improper citation) in:
4028 Understanding the Impact of E-Commerce Software on the Adoption of
4029 Structured Data on the Web
4030 http://link.springer.com/chapter/10.1007/978-3-642-38366-3_9#page-1
4032 * GNU Parallel was used (unfortunately with improper citation) in:
4033 CWI at TREC 2012, KBA track and Session Track
4034 http://trec.nist.gov/pubs/trec21/papers/CWI.kba.session.final.pdf
4036 * Mitigation of Adverse Effects Caused by Shock Wave Boundary Layer
4037 Interactions through Optimal Wall Shaping.
4038 http://arc.aiaa.org/doi/abs/10.2514/6.2013-2653
4040 * Using GNU parallel to convert images.
4041 http://www.brunokim.com.br/blog/?p=18
4043 * A quick way to parallelize.
4044 http://timotheepoisot.fr/2013/07/08/parallel/
4046 * GNU Parallel 20130522 ('Rana Plaza') 发布,并行作业执行.
4047 http://www.open-open.com/news/view/371301
4049 * Quite a few bug fixes and man page updates.
4054 * --xapply now recycles arguments if an input source has more
4055 arguments than others.
4057 * The sleep time between jobs is now both increased and decreased
4060 * 10 seconds installation check the signature using GnuPG if GnuPG is
4063 * Developer job asking for GNU Parallel expertise.
4064 http://careers.stackoverflow.com/jobs/35562/developer-big-data-geo-and-web-climate-central
4066 * A small utility program to run youtube-dl in parallel.
4067 https://github.com/dlh/youtube-dl-parallel
4069 * Parallelizing Freesurfer:
4070 http://blog.cogneurostats.com/?p=148
4072 * Bug fixes and man page updates.
4077 * --ctrlc is now default if --pipe is not used; thus making it
4078 possible to kill remotely started jobs simply by pressing Ctrl-C.
4080 * --timeout 200% now means kill jobs that take more than twice the
4081 time of the median run time of a job.
4083 * Jobs are now distributed round robin when having mulitiple
4084 --sshlogin instead of filling up one --sshlogin at a time.
4086 * niceload: darwin version of --io --mem --swap. Thanks to Anders F
4089 * Bug fixes and man page updates.
4094 * 10 seconds installation: wget -O - pi.dk/3 | sh
4096 * HPUX CPU/core detection. Thanks to Javier Tarradas.
4098 * CPU detection for HURD, IRIX, SCO OpenServer and (old) HPUX.
4100 * --ctrlc will send SIGINT to tasks running on remote computers and
4103 * --load now uses 'ps' to see immediately see the number of running
4104 processes instead of 'uptime' thus making --load react much faster.
4106 * Testing on Centos 3.9 and FreeBSD 7 revealed a lot of compability
4107 bugs. Some of these required quite extensive changes making this
4108 release beta quality.
4110 * --retries works with --onall.
4112 * The new --load computation now works on FreeBSD 7.
4114 * --nice works under tcsh.
4116 * GNU Parallel is officially supported in NetBSD.
4117 http://ftp.netbsd.org/pub/pkgsrc/current/pkgsrc/parallel/parallel/README.html
4119 * GNU Parallel is accepted for openSUSE.
4120 http://software.opensuse.org/package/gnu_parallel
4122 * GNU Parallel can be installed under Microsoft Windows (CygWin).
4123 http://blogs.msdn.com/b/hpctrekker/archive/2013/03/30/preparing-and-uploading-datasets-for-hdinsight.aspx
4125 * Excuses for not installing GNU Parallel.
4126 http://oletange.blogspot.dk/2013/04/why-not-install-gnu-parallel.html
4128 * Job advert that requires GNU Parallel competence.
4129 http://versium.com/about/careers/
4131 * Parallelizing Batch Jobs for Fun and Profit.
4132 http://mikeseidle.com/tech/programming/2013/03/parallelizing-batch-jobs
4134 * Processing Transcription Start Sites(TSS) for the entire Mouse genome.
4135 http://qbrc.swmed.edu/2013/03/gnu-parallel-speeding-up-unix-commands-and-scripts/
4137 * GNU parallel is used throughout Scrimer.
4138 http://scrimer.readthedocs.org/en/latest/
4140 * GNU Parallel helped making public documents searchable.
4141 http://danpalmer.me/blog/articles/2013-04-06-unlocking-hillsborough.html
4143 * Identifying big movie files (German).
4144 http://blackappsolutions.wordpress.com/2013/03/23/wenn-der-plattenplatz-knapp-wird-filme-identifizieren-die-viel-platz-belegen/
4146 * Bug fixes and man page updates.
4151 * --resume works with --pipe.
4153 * --resume-failed will go through --joblog, redo the failed jobs and
4154 then continue like --resume.
4156 * Negative positional arguments count from the end: {-1} means the
4157 last argument, {-2} the second to last.
4159 * NetBSD CPU detection.
4161 * --blocksize increases exponentially if it smaller than a full
4164 * Processing n-line records (--pipe -L n) is now much faster.
4166 * --tollef is obsoleted after discussion on the mailing list.
4168 * GNU Parallel is the highest rated tool on:
4169 http://www.biostars.org/show/tools/?sort=votes&since=all%20time
4171 * GNU Parallel was loved during FSFE's #ilovefs campaign.
4172 http://fsfe.org/news/2013/news-20130212-01.en.html
4174 * Using GNU Parallel with s3cmd (Japanese).
4175 http://blog.suz-lab.com/2013/02/s3cmd-gnu-paralells3.html
4177 * Intro to GNU Parallel (Chinese).
4178 http://guiquanz.github.com/2013/02/12/gnu-parallel-intro/
4180 * Bug fixes and man page updates.
4185 * --sshdelay Delay starting next ssh by secs seconds. GNU parallel
4186 will pause secs seconds after starting each ssh. secs can be less
4189 * Official OpenBSD port:
4190 http://ftp.openbsd.org/ports/sysutils/parallel/
4192 * Official DragonFlyBSD package:
4193 http://www.mirrorservice.org/sites/ftp.dragonflybsd.org/packages/amd64/DragonFly-3.0.0/stable/parallel/
4195 * Post about niceload in Hungarian:
4196 http://commandline.blog.hu/2013/01/02/niceload
4198 * 自炊スキャンデータをKobo Gloに最適化
4199 http://interstadial.wordpress.com/2013/01/20/
4201 * GNU parallel+ssh で複数のリモートホストに複数のコマンドを実行させる
4202 http://oshiire.to/archives/1686
4204 * Bug fixes and man page updates.
4209 * --shebang-wrap makes is possible to parallelize scripts by putting
4210 parallel in the shebang line (the first #! line in scripts).
4212 * --delay puts in a delay after starting each job. Useful to avoid
4213 raceconditions and thundering herd problems.
4215 * --results now uses / as separator instead of TAB and thus creates
4216 subdirs. Thanks to Drew Frank.
4218 * parallel: OpenBSD CPU detection. Thanks to Michał Markowski.
4220 * niceload --sensor allows for negative numbers to signify a lower
4221 number means the limit is lower.
4223 * niceload --prg suspend a named program that is already running.
4225 * niceload multiple --pid suspend process ids that are already running.
4227 * Convertir des images avec find et imagemagick
4228 http://roger.b.over-blog.com/article-convertir-des-images-avec-find-et-imagemagick-113416637.html
4230 * Bug fixes and man page updates.
4235 * niceload --sensor makes it possible to use a program to control if a
4236 program should be suspended.
4238 * GNU Parallel was part of the justification for Nordic Free Software
4240 https://fsfe.org/news/2012/news-20121112-01.html
4242 * Dateien schneller packen und konvertieren mit GNU parallel
4243 http://www.linux-community.de/Archiv/Tipp-der-Woche/Dateien-schneller-packen-und-konvertieren-mit-GNU-parallel
4245 * Processing images from Lunar Reconnaissance Orbiter Narrow Angle
4246 Camera http://lunokhod.org/?p=774
4248 * GNU Parallel is used in types2: Type and Hapax Accumulation Curves
4249 http://www.cs.helsinki.fi/u/josuomel/types2/
4251 * GNU Parallel used in: A Hybrid Factor Analysis and Probabilistic
4252 PCA-based system for Dictionary Learning and Encoding for Robust
4254 http://www.superlectures.com/odyssey2012/lecture.php?id=8&lang=en
4255 http://www.cse.iitm.ac.in/~mrsri/ppca.pdf
4257 * Mapreduce avec parallel, cat et une redirection
4258 http://datacratic.com/site/blog/mapreduce-avec-parallel-cat-et-une-redirection
4260 * GNU Parallel for Large Batches of Small Jobs
4261 https://support.scinet.utoronto.ca/wiki/images/7/7b/Tech-talk-gnu-parallel.pdf
4263 * GNU Parallel used in black belt tip (8:50-10:12)
4264 https://aws.amazon.com/apac/awspodcast/episode20/
4266 * Bug fixes and man page updates.
4271 * --results structures output files so they can be imported using
4272 Pandas (http://pandas.pydata.org/). Useful when doing simulations to
4273 select output from some arguments.
4275 * Use --env to transfer environment variables through ssh to remote
4278 * GNU Parallel is accepted for Ubuntu Quantal.
4279 http://packages.ubuntu.com/quantal/parallel
4281 * GNU Parallel was requested for OpenSUSE (go vote!)
4282 https://features.opensuse.org/314461
4284 * Kneth's Korner: Map/Reduce and GNU Parallel
4285 http://kenneth.geisshirt.dk/2012/10/mapreduce-and-gnu-parallel.html
4287 * Blog post in Japanese by Siguniang.
4288 https://siguniang.wordpress.com/2012/09/09/notes-on-gnu-parallel-the-command-line-power-tool/
4289 (Siguniang mentions the logo is called 'The Cafe Wall Illusion')
4290 http://www.michaelbach.de/ot/ang_cafewall/index.html
4292 * GNU Parallel, where have you been all my life?
4293 http://ssdigit.nothingisreal.com/2012/09/gnu-parallel-where-have-you-been-all-my.html
4295 * Reference-free ddRADseq analysis tools uses GNU Parallel.
4296 https://github.com/brantp/rtd#readme
4298 * When bash just isn’t quick enough.
4299 https://soimasysadmin.wordpress.com/2012/08/15/gnu-parallel-when-bash-just-isnt-quick-enough/
4301 * Using GNU Parallel to Package Multiple Jobs in a Single PBS Job.
4302 http://www.nas.nasa.gov/hecc/support/kb/Using-GNU-Parallel-to-Package-Multiple-Jobs-in-a-Single-PBS-Job_303.html
4304 * GNU Parallel Notes.
4305 http://xed.ch/help/parallel.html
4307 * Bug fixes and man page updates.
4312 * Due to a bugfix the main flow has changed. Making this release beta
4315 * Parallel Proxy Scraper & Checker Tool
4316 https://www.youtube.com/watch?v=iXCeR_XsP6o
4318 * Bug fixes and man page updates.
4323 * GNU Parallel was presented at Chiang Mai Bar Camp
4324 http://barcampchiangmai.org/
4326 http://www.cnx-software.com/2012/07/02/use-gnu-parallel-to-speed-up-script-execution-on-multiple-cores-andor-machines/
4328 * I don't always max out all my CPUs, but when I do, I do it with GNU
4330 http://memegenerator.net/instance/22638454
4332 * Bug fixes and man page updates.
4337 * '-L n --pipe' will use records of n lines. This is useful when
4338 processing data that have fixed records with a fixed number of
4341 * --filter-hosts will remove down hosts. For each remote host: check
4342 that login through ssh works. If not: do not use this host.
4343 Currently you can not put --filter-hosts in a profile, $PARALLEL,
4344 /etc/parallel/config or similar. This is because GNU Parallel uses
4345 GNU Parallel to compute this, so you will get an infinite loop. This
4346 will likely be fixed in a later release.
4348 * --pipe now uses fork() instead of busy wait. The performance should
4349 be better on computers with >10 cores while remaining the same on
4350 computers with few cores.
4352 * GNU Parallel will be represented at Chiang Mai Bar Camp.
4353 http://barcampchiangmai.org/
4355 * Indexing Big Data on Amazon AWS: The Screencast
4356 (Check out his T-shirt at 18:40-21:00).
4357 http://www.opensourceconnections.com/2012/06/06/indexing-big-data-on-amazon-aws-screencast/
4359 * biotoolbox uses GNU Parallel.
4360 https://code.google.com/p/biotoolbox/wiki/Pod_novo_wrapper
4362 * Spiceweasel uses GNU Parallel.
4363 https://github.com/mattray/spiceweasel
4365 * GNU Parallel part of The Administrators Challenge.
4366 http://challenge.twistedrack.com/questions/qs3.php
4368 * Finding Oldest Firefox Code using GNU Parallel.
4369 http://gregoryszorc.com/blog/2012/06/18/finding-oldest-firefox-code/
4371 * Bug fixes (quite a few for remote job running) and man page updates.
4376 * Timings in --joblog now with milliseconds.
4378 * Thesis using GNU Parallel (correctly cited; hooray!).
4379 http://scholarworks.sjsu.edu/etd_projects/222/
4382 http://www.perzl.org/aix/index.php?n=Main.Parallel
4384 * Prokka uses GNU Parallel.
4385 http://bioinformatics.net.au/prokka-manual.html
4387 * GNU Parallel was presented at MUUG.
4388 http://muug.mb.ca/blog/meetings/2012/05/09/may-8th-2012-rtfm-gnu-parallel1/
4390 * Blog post: Manipulating many or large files with GNU parallel.
4391 http://compbiously.blogspot.com/2012/05/manipulating-many-or-large-files-with.html
4393 * Blog post: Running commands in parallel using bash.
4394 http://blog.michaelboman.org/2012/04/running-commands-in-parallel-using-bash.html
4396 * Blog post in Hungarian.
4397 http://commandline.blog.hu/2012/05/03/gnu_parallel
4399 * Popularity of GNU Parallel in Debian explodes.
4400 http://qa.debian.org/popcon-graph.php?packages=parallel
4402 * Bug fixes and man page updates.
4407 * A race condition bug caused restructuring of a central piece of the
4408 code. Thus this release of GNU Parallel should be considered beta
4411 * sql --dbsize will now list sizes of all databases if given no
4414 * GNU Parallel is now in Debian Unstable.
4415 apt-get install parallel
4417 * Article: Computational and experimental analyses of
4418 retrotransposon-associated minisatellite DNAs in the soybean genome.
4419 http://www.biomedcentral.com/content/supplementary/1471-2105-13-s2-s13-s1.pdf
4421 * Blog post: GNU parallel - the best thing since sliced bread.
4422 https://arrayal.wordpress.com/2012/03/27/gnu-parallel-the-best-thing-since-sliced-bread/
4424 * Blog post: GNU Parallel makes everything faster.
4425 http://compbiously.blogspot.com/2012/03/gnu-parallel-makes-everything-faster.html
4427 * Blog post (German): Howto: GNU parallel.
4428 http://d24m.de/2012/04/05/howto-gnu-parallel/
4430 * Blog post: Running in Parallel
4431 http://interactivity.ifactory.com/2012/04/running-in-parallel/
4433 * 20000 watched the first intro video.
4436 * The first 5 have received their GNU Parallel merchandise
4437 https://www.gnu.org/software/parallel/merchandise.html
4439 * Bug fixes and man page updates.
4444 * Parallel Process Database Dumps.
4445 http://blog.mattoates.co.uk/2012/02/parallel-process-database-dumps.html
4447 * Using GNU Parallel to process images from Mars.
4448 http://lunokhod.org/?p=468
4450 * Using GNU Parallel with bzgrep.
4451 http://filip.rembialkowski.net/did-you-know-gnu-parallel/
4453 * Bug fixes and man page updates.
4458 * --workdir . will use the current working dir. If the current working
4459 dir is beneath your home dir, the value . is treated as the relative
4460 path to your home dir. This means that if your home dir is different
4461 on remote computers (e.g. if your login is different) the relative
4462 path will still be relative to your home dir.
4464 * A texinfo file is now generated from the POD file using pod2texi.
4466 * The bioinformatics article "Fast large-scale clustering of protein
4467 structures using Gauss integrals" mentions GNU Parallel. They forgot
4468 to add the reference. Please remember --bibtex if you use GNU
4469 Parallel in an article.
4470 http://bioinformatics.oxfordjournals.org/content/28/4/510.short
4472 * The first supporter received his merchandise. Did you order yours?
4473 https://www.gnu.org/software/parallel/merchandise.html
4475 * How to use GNU Parallel with samtools.
4476 http://zvfak.blogspot.com/2012/02/samtools-in-parallel.html
4478 * How to use GNU Parallel for vacuuming PostgreSQL tables.
4479 http://blog.timmattison.com/archives/2012/01/24/mini-hack-parallel-vacuuming-in-postgresql/
4481 * Converting e-books with Calibre and GNU Parallel.
4482 http://www.linkhal.de/blog/2012/01/converting-massive-e-book-collections-with-calibre-and-gnu-parrallel/
4484 * Using GNU Parallel for tailing logfiles from multiple servers.
4485 http://silviud.blogspot.com/2012/02/shell-parallel-processing.html
4487 * Bug fixes and man page updates.
4492 * --header : uses the first input line as column names and you can
4493 then use {colname} as a replacement string in the command. This also
4494 works with multiple :::'s.
4496 * --header <regexp> matches a header as a regular expression and
4497 repeats the header for each block with --pipe.
4499 * --resume resumes from the last unfinished job. Useful if you stop
4500 GNU Parallel and restart it later with the same arguments.
4502 * niceload now propagates exit status correctly.
4504 * Show your support for GNU Parallel. For a limited time you can get a
4505 GNU Parallel T-shirt+mug+pen+100 postcards at 20 EUR. See
4506 https://www.gnu.org/software/parallel/merchandise.html
4508 * Options -g -B -T -U -W -Y are retired as warned 6 months ago.
4510 * GNU Parallel referenced in article on Holographic Grid Cloud. Thanks
4511 to Stefano Gallozzi. http://arxiv.org/pdf/1112.6128
4513 * Article in IEEE Software on GNU Parallel. Thanks to Diomidis
4514 Spinellis. http://www.spinellis.gr/blog/20110911/
4516 * An article on Narwhal which uses GNU Parallel. They forgot to add
4517 the reference. Please remember --bibtex if you use GNU Parallel in
4519 http://bioinformatics.oxfordjournals.org/content/early/2011/11/08/bioinformatics.btr613.full.pdf
4521 * Blog post on using GNU Parallel to speed up BLAST queries:
4522 http://blog.mckuhn.de/2012/01/embarrassingly-parallel-blast-search.html
4524 * Video showing Wake-on-LAN with GNU Parallel.
4525 https://www.youtube.com/watch?v=0mB-yIyKFLQ
4527 * Using GNU Parallel with Solr.
4528 http://sujitpal.blogspot.com/2011/12/solr-report-generation-with-python.html
4530 * First job ad including GNU Parallel:
4531 http://seeker.dice.com/jobsearch/servlet/JobSearch?op=101&dockey=xml/7/6/76f858de083a094f74b1a5d3ba53ffc5@endecaindex
4533 * Bug fixes and man page updates.
4538 * --timeout will now kill grandchildren.
4540 * Interview in Hacker Public Radio.
4541 http://hackerpublicradio.org/eps.php?id=0860
4543 * Blog post in Chinese.
4544 http://blog.sina.com.cn/s/blog_3f7652740100y0ju.html
4546 * Bug fixes and man page updates.
4551 * GNU Parallel package for Fedora.
4552 https://admin.fedoraproject.org/pkgdb/acls/name/parallel
4554 * Using GNU Parallel with Mozilla cross referencing.
4555 https://blog.mozilla.com/it/2011/11/15/mxr-improvements/
4557 * Neat flash presentation of GNU Parallel.
4558 http://prezi.com/0nq74b2elgtx/about-gnu-parallel/
4560 * How to create tar files of dirs in parallel.
4561 https://joneslee85.wordpress.com/2011/11/22/shell-tips-how-to-recursively-archive-many-folders/
4563 * Article in Admin Network&Security by Ben Martin.
4564 http://www.admin-magazine.com/HPC/Articles/GNU-Parallel
4566 * Blog post in Polish.
4567 http://blog.tiger.com.pl/2011/01/05/gnu-parallel/
4569 * Blog post on using GNU Parallel of Mac OS X.
4570 http://www.0xcb0.com/2011/10/19/running-parallel-bash-tasks-on-os-x/
4572 * Blog post in English by researcher.
4573 http://zandyware.wordpress.com/2011/10/15/gnu-parallell-make-best-use-of-your-multicore-computer/
4575 * Blog entry in Chinese.
4576 http://blog.csdn.net/tossense/article/details/6889026
4578 * Blog entry in Japanese on managing many servers.
4579 http://hiroakis.com/blog/2011/11/13/gnu-parallel/
4581 * GNU Parallel is now part of ppbs.
4582 http://physiology.med.cornell.edu/faculty/mason/lab/ppbs/introduction/introduction.html
4584 * How to use GNU Parallel with MCX.
4585 http://mcx.sourceforge.net/cgi-bin/index.cgi?MMC/Doc/MMCCluster
4587 * Bug fixes and man page updates.
4592 * --tag prepends lines with the argument(s). If used with --(n)onall
4593 the line will be prepended with the sshlogin instead.
4595 * --shellquote does not run the command but quotes it using \'s.
4596 Useful for making quoted composed commands.
4598 * --profile can now be repeated merging multiple profiles.
4600 * --bibtex now gives the BibTeX entry.
4601 Thanks to Aleksandr Levchuk for testing.
4603 * Makefile for simple .deb package.
4604 cd packager/debian; make
4606 * sql: --list-databases lists the databases.
4608 * GNU Parallel officially in Fedora 16
4609 http://www.spinics.net/lists/fedora-package-announce/msg67130.html
4611 * Blog post on recompression FLAC audio.
4612 http://blog.oxplot.com/2011/08/reflac-flac-cleanser.html
4614 * The most complex use of ::: I have seen so far.
4615 http://agentzlerich.blogspot.com/2011/09/following-up-on-previous-failures-ive.html
4617 * Example of using GNU Parallel with sudo.
4618 http://loopkid.net/articles/2011/10/07/recursive-chmod-and-chown-on-files
4620 * Use wget and gnu parallel to download mp3s at rocket speed.
4621 http://sdbrain.posterous.com/use-wget-and-gnu-parallel-to-download-mp3s-at
4623 * First CV referring to GNU Parallel.
4624 http://www.peopleperhour.com/freelancers/stephen_/internet_researcher_and_protocol_develop/140602
4626 * Cartwright labs usage of GNU Parallel.
4627 http://cartwrightlab.wikispaces.com/The+Most+Bang+for+Your+Buck
4629 * Bug fixes and man page updates.
4634 * --timeout implemented so that slow commands can be killed
4636 * CPU detection improved for Mac OSX. Thanks to Wayne E. Seguin.
4638 * Example of a parallel webcrawler in the man page.
4640 * Backup up PostgreSQL with GNU Parallel. Thanks to Stephane Wirtel.
4641 http://wirtel.be/2011/07/15/rsync_parallel/
4643 * Blog post in Japanese.
4644 http://dminor11th.blogspot.com/2011/08/gnu-parallel.html
4646 * Blog post about optimizing JPEGs. Thanks to Thomas Jost.
4647 http://schnouki.net/2011/07/22/optimizing-jpeg-pictures/
4649 * Bug fixes and man page updates.
4654 * niceload: --hard will suspend a program if a limit is reached - as
4655 opposed to just slowing the program down.
4657 * niceload: --soft will slow the program down - as opposed to
4658 suspending the program completely.
4660 * niceload: --run-io will slow down a program if disk io goes above a
4663 * niceload: --run-load will slow down a program if loadaverage goes
4664 above a certain limit.
4666 * niceload: --run-mem will slow down a program if free memory goes
4667 below a certain limit.
4669 * niceload: --run-noswap will slow down a program if the computer is
4672 * niceload: --start-io, --start-load, --start-mem, --start-noswap will
4673 defer starting a program until the system is below the limit.
4675 * --io, --load, --mem, and --noswap sets both --run-* and --start-*.
4677 * niceload got a major rewrite and is now object oriented.
4679 * GNU Parallel was presented at Nordic Perl Workshop 2011.
4680 http://conferences.yapceurope.org/npw2011/talk/3416
4682 * Blog post about zcat and GNU Parallel. Thanks to Dr. John.
4683 http://drjohnstechtalk.com/blog/2011/06/gnu-parallel-really-helps-with-zcat/
4685 * 2 blog posts in Japanese. Thanks to Negima.
4686 http://d.hatena.ne.jp/negima1976/20110607/1307412660
4687 http://d.hatena.ne.jp/negima1976/20110628/1309252494
4689 * Blog post for bioinformatics. Thanks to Chris Miller.
4690 http://chrisamiller.com/science/2010/05/26/use-parallel-for-easy-multi-processor-execution/
4692 * Bug fixes and man page updates.
4697 * --onall will run all the jobs on all the computers. This is useful
4698 for systemadinistrators having multiple servers.
4700 * --nonall runs like --onall but reads no arguments from stdin
4701 (standard input), so is possible to do:
4702 parallel --nonall -S computer1,computer2 uptime
4704 * Context replace now works with multiple input sources:
4705 parallel -X echo {1}-{2} ::: 1 2 3 ::: a b c
4707 * --noswap do not start a job on a server that is swapping.
4709 * Article: Parallel processing without Hadoop!
4710 http://www.solutionhacker.com/parallel-processing-without-hadoop/
4712 * Article in Linux Magazine (Spanish). Thanks to Ben Martin.
4713 http://www.linux-magazine.es/issue/67/
4715 * First blog post in Korean. Thanks to 민병국.
4716 http://blog.daum.net/_blog/BlogTypeView.do?blogid=02RQ3&articleno=13380895&admin=#
4718 * Blog post in Japanese. Thanks to Naoya Nakazawa.
4719 http://www.sssg.org/blogs/naoya/archives/2003
4721 * Blog post in English. Thanks to Dagon.
4722 http://hekate.homeip.net/2011/05/29/
4724 * Bug fixes and man page updates.
4729 * Multiple ::: can be put on the command line and will be treated
4730 similar to contents from multiple -a's.
4732 * ::: and :::: can now be mixed on the command line. Use {1} .. {n} to
4733 refer to inputs from the different input sources.
4735 * --xapply is now needed to get xapply's behaviour of reading one line
4736 from each of the input sources.
4738 * Multiple input sources will cause all combinations of arguments from
4739 the sources to be generated. E.g. 'parallel echo {1}+{2} ::: 1 2 :::
4740 a b c' will print 1+a 1+b 1+c 2+a 2+b 2+c. This can often replace
4743 * Implemented {//} for the input line with the basename removed (dirname).
4745 * New video showing the new ::: and :::: input sources.
4746 http://tinyogg.com/watch/iOdhU/ http://www.youtube.com/watch?v=fOX1EyHkQwc
4748 * GNU Parallel now has a logo.
4749 http://www.gnu.org/software/parallel/logo.png
4751 * Article about GNU SQL in USENIX Magazine ;login: (print)
4752 http://www.usenix.org/publications/login/2011-04/
4754 * Using GNU Parallel with EC2. Thanks to Kevin Wu.
4755 http://blog.kevinformatics.com/post/4970574713/interested-in-your-experience-using-gnu-parallel-in
4757 * Review with idea for {..} and {...} in Japanese. Thanks to ichii386.
4758 http://d.hatena.ne.jp/ichii386/20110426
4760 * Upgrade GNU Parallel using Macports. Thanks to Phil Hollenback.
4761 http://www.hollenback.net/index.php/MacportsParallel
4763 * Robert from Echo One discusses using processes instead of threads:
4764 http://rrees.wordpress.com/2011/04/25/many-cores-many-threads/
4766 * How to run GNU Parallel on a SLURM cluster. Thanks to Kevin Stock.
4767 http://www.kevinstock.org/2011/04/using-the-ri-cluster/
4769 * Short article about using GNU Parallel with lame:
4770 http://loopkid.net/articles/2011/04/30/accelerate-lame-mp3-conversion
4772 * Using GNU Parallel to run tail -f in Japanese. Thanks to Clouder.
4773 http://blog.clouder.jp/archives/001140.html
4775 * BBC Research & Development uses GNU Parallel:
4776 http://www.bbc.co.uk/blogs/researchanddevelopment/2010/11/prototyping-weeknotes-41-26112.shtml
4778 * Short article about using GNU Parallel on RHEL. Thanks to Rishi Deshpande.
4779 http://nuclear-imaging.info/site_content/2011/05/11/gnu-parallel/
4781 * Using GNU Parallel for FLAC->MP3 conversion. Thanks to Derek Marcotte.
4782 http://derek.chezmarcotte.ca/?p=286
4784 * Bug fixes and man page updates.
4789 * {#} now works as an alias for $PARALLEL_PID.
4791 * --eta now estimates way more accurately.
4793 * CPU detection code for AIX thanks to Christian Netrwal.
4795 * --joblog contains exitcode.
4797 * Thanks to Ævar Arnfjörð Bjarmason for reading my code.
4799 * GNU Parallel was presented at:
4800 - LUGA, Augsburg, 2011-03-26, http://www.luga.de/Aktionen/LIT-2011/Programm
4801 - OSAA.dk, Aarhus, 2011-04-12
4803 * Blog entry in Japanese. Thanks to Riywo.
4804 http://blog.riywo.com/2011/04/19/022802
4806 * Example of how to use GNU Parallel on PBS clusters. Thanks to Andrew
4807 J Dolgert: http://web0.tc.cornell.edu/wiki/index.php?title=Gnu_Parallel
4809 * First example of using GNU Parallel in Hebrew. Thanks to omry.
4812 * Intro video got past 10000 hits.
4813 http://www.youtube.com/watch?v=OpaiGYxkSuQ
4815 * Bug fixes and man page updates.
4820 * --tollef to be switch compatible with Tollef's parallel. This will
4821 cause -l to mean --load, and the argument separator will be --
4824 * --gnu will force GNU Parallel to behave like GNU Parallel even if
4827 * Site wide config file: /etc/parallel/config
4829 This should solve the issue with some packagers renaming GNU
4830 Parallel to gparallel to avoid the naming conflict.
4832 By putting --tollef in the site wide config file you can deinstall
4833 Tollef's parallel and install GNU Parallel instead without any
4834 change for users or scripts. This is useful for packagers that
4835 currently rename GNU Parallel or simply do not distribute GNU
4836 Parallel because the command name conflicts with Tollef's parallel.
4838 * -L 0 -n 0, and -N 0 implemented. They will read one argument,
4839 but insert 0 arguments on the command line. Useful if you just want
4840 to run the same command with the same arguments a number of times.
4842 * GNU Parallel is now in Fink. Thanks to Jesse Alama.
4843 http://pdb.finkproject.org/pdb/package.php/parallel
4845 * Opscode Cookbook for Chef. Thanks to Joshua Timberman.
4846 https://github.com/opscode/cookbooks/tree/master/gnu_parallel
4848 * Man page examples translated into Japanese. Thanks to Koshigoe.
4849 http://w.koshigoe.jp/study/?%5Bsystem%5D+GNU+parallel+%BB%C8%CD%D1%CE%E3#l13
4851 * GNU Parallel will be presented at:
4852 - LUGA, Augsburg, 2011-03-26, http://www.luga.de/Aktionen/LIT-2011/Programm
4853 - OSAA.dk, Aarhus, 2011-04-12
4855 * Video of presentation from FSCONS 2010-11-07. The presenter was
4856 _really_ hoarse that day (Something to do with loads of alcohol the
4857 night before). http://vimeo.com/20838834
4859 * Review with examples in German. Thanks to M. Nieberg.
4860 http://kenntwas.de/2011/linux/gnu-parallel/
4862 * A review of the --pipe option in German. Thanks to Mathias Huber.
4863 http://www.linux-magazin.de/NEWS/GNU-Parallel-20110205-stueckelt-Daten
4865 * A small example of grepping maillogs. Thanks to François Maillet.
4866 http://www.francoismaillet.com/blog/?p=399
4868 * Using GNU Parallel instead of xargs. Thanks to James Cuff.
4869 http://blog.jcuff.net/2011/02/on-train-ride-in.html
4871 * Bug fixes and man page updates.
4876 * --pipe splits piped data into blocks. Each block is piped to a
4877 program for processing. The piping and the programs will be run in
4878 parallel. Useful if the data you want to process is data for a
4879 program and not arguments.
4881 * --blocksize sets the blocksize in bytes for --pipe. The blocksize is
4882 approximate. It can deviate as much as the size of one record.
4885 * --recstart sets the string matching the start of a
4886 record. Default is "".
4888 * --recend sets the string matching the end of a
4889 record. Default is '\n'. To specify none use --recend "".
4891 If both --recstart and --recend are set, the end of a record must be
4892 followed immediately by a start of a record. This is useful if
4893 either recend or recstart can occur in the middle of a record.
4895 * --remove-rec-sep removes the string matched by --recstart and
4898 * --regexp will make GNU Parallel treat --recstart and --recend as
4899 regular expressions.
4901 * --output-as-files will put the output of the programs into files and
4902 instead of giving the output GNU Parallel will output the name of
4905 * -N if used with --pipe sets the number of records to read.
4907 * New video showing --pipe at
4908 http://www.youtube.com/watch?v=1ntxT-47VPA
4910 * GNU Parallel was presented at FOSDEM.
4912 * Article in USENIX Magazine ;login: (print)
4913 http://www.usenix.org/publications/login/2011-02/
4915 * GNU Parallel is now on ohloh.net. Thanks to Wim Muskee.
4916 https://www.ohloh.net/p/gnu-parallel
4918 * Advanced recursive example. Thanks to Ruarí Ødegaard.
4919 http://my.opera.com/ruario/blog/2011/01/24/editing-debian-packages-more-fun-with-gnu
4921 * Small example on using GNU Parallel through 0install (German).
4922 http://forum.ubuntuusers.de/topic/gnu-parallel-mit-zero-install-kurzinfo-kein-wi/
4924 * Bug fixes and man page updates.
4929 * --joblog makes a simple log of completed jobs.
4931 * -X now spreads arguments between job slots when reaching last
4932 argument. Use -j1 to avoid this.
4934 * People on the email list have voted -j+0 to be the new default
4937 * First review in Polish. Thanks to Patryk Krawaczyński.
4938 http://nfsec.pl/root/2458
4940 * Review in Spanish (in print).
4941 https://www.linux-magazine.es/issue/67/moreinfo.html
4943 * Review in English. Thanks to Brian Gough.
4944 http://blogs.fsfe.org/bjg/2011/01/gnu-parallel-a-map-operator-for-the-command-line/
4946 * Review in French. Thanks to Denis Dordoigne.
4947 http://linuxfr.org/2010/12/29/27715.html
4949 * Review in Spanish.
4950 http://gufete.net/index.php?entry=entry110116-200022
4952 * Article with advanced recursive example. Thanks to Ruarí Ødegaard
4953 http://my.opera.com/ruario/blog/2011/01/18/fun-with-gnu-parallel
4955 * Use case for memcache.
4956 http://www.dctrwatson.com/2010/12/how-to-dump-memcache-keyvalue-pairs-fast/
4958 * Bug fixes and man page updates.
4963 * GNU niceload is now part of GNU Parallel. GNU niceload slows down a
4964 program if the load average is above a certain limit.
4966 * Implemented --tmpdir to buffer standard output and standard error in
4969 * Implemented --load to wait until the load is below a limit before
4970 starting another job on that computer.
4972 * Implemented --nice set the niceness of jobs running both locally and
4975 * Implemented --dry-run to print the job without running it.
4977 * Implemented --tty as the old default of assigning a tty to the first
4978 job causes problems.
4980 * Review with focus on clusters. Thanks to Taylor Gillespie
4981 http://www.unixpronews.com/unixpronews-49-20101019GNUParallelSpeedUpProcessingWithMulticoresClusters.html
4983 * Review with focus on protein similarity.
4984 http://kevinformatics.tumblr.com/post/2142473893/cluster-like-computing-using-gnu-parallel
4986 * Review in Spanish.
4987 http://gr3p.com/2010/12/gnu-parallel-acelera-tus-scripts-en-linux
4989 * Quite a few bug fixes and man page updates.
4994 * Implemented {/} for the input line with the path removed (basename).
4996 * Implemented {/.} for the input line with extension and path removed
4999 * Output from --progress is now sent to standard error instead of
5002 * --eta was broken and counted down from 0. Now fixed.
5004 * Standard output and standard error are flushed after every job so if
5005 standard output does not end with a newline it will still be grouped
5006 with the rest of standard output.
5008 * --command, -c, --file, and -f are now removed as options. They were
5009 never used in practice.
5011 * GetOptionsFromArray rewritten to work with old Perl libraries.
5013 * The file COPYING now contains the GNU General Public License 3
5015 * Major rewrite to make the code more object oriented and easier to
5016 maintain in the future.
5021 * Using -j myfile the number of jobs can be changed while GNU Parallel
5022 is running simply by changing the content of myfile.
5024 * Implemented --profile to use different .parallel/config for
5025 different situations.
5027 * Ugly newlines in $PARALLEL and .parallel/config are no longer
5028 needed. Instead you have to use \ in front of special shell
5031 * --workdir puts the files transferred to remote machines in a
5032 specified directory.
5034 * $PARALLEL_PID is set to the process id of GNU Parallel.
5036 * $PARALLEL_SEQ is set to the sequence number of the job.
5038 * -v now only shows the command to run. Use -v -v to show the
5041 * Slow spawning error is now only a warning.
5043 * If stdin is a tty and input is read from stdin you now get a
5046 * GNU sql: \n and \x0a in arguments is replaced with newline.
5048 * Patch for Debian package and spelling mistakes. Thanks to Rogério
5049 Brito <rbrito at ime dot usp dot br>
5051 * Mac OS X Homebrew package. Thanks to Jonathan Palardy <jonathan dot
5052 palardy at gmail dot com>
5054 * FreeBSD port. Thanks to Chris Howey <howeyc at gmail dot com>
5056 * Pardus package. Thanks to Fethican Coşkuner
5057 <fethicanc at gmail dot com>
5059 * First review in Chinese. Thanks to 曾義峰:
5060 http://antbsd.twbbs.org/~ant/wordpress/?p=2876
5062 * First review in print:
5063 http://www.linux-magazine.com/Issues/2010 Nov 2010
5065 * First review in Spanish:
5066 http://www.muylinux.com/2010/10/18/gnu-parallel-computacion-paralela-a-golpe-de-comando
5068 * First review in Dutch thanks to Koen Vervloesem <koen at vervloesem
5070 http://techworld.nl/technologie/33493/gebruik-al-je-processorkernen-met-gnu-parallel.html
5072 * Blog review thanks to R. Tyler Croy <tyler at monkeypox dot org>:
5073 http://unethicalblogger.com/posts/2010/11/gnuparallel_changed_my_life
5075 * 5000 views of the intro video:
5076 http://www.youtube.com/watch?v=OpaiGYxkSuQ
5078 * As usual a bunch of bugfixes and more usage examples in the man
5081 * GNU Parallel was presented at FSCONS 2010-11-07:
5082 http://www.fscons.org/fs/gnu-parallel Hopefully the
5083 video will be online soon.
5088 * See GNU Parallel live at FSCONS 2010-11-07:
5089 http://www.fscons.org/fs/gnu-parallel
5091 * Untested Debian and xUbuntu packages available through OpenSUSE
5093 https://build.opensuse.org/package/show?package=parallel&project=home%3Atange
5095 * Using --retries a job will be retried on another computer if it
5096 fails. This is useful if some jobs fail for no apparent reason (such
5097 as network failure).
5099 * BSD xargs -o (open /dev/tty) is now default for the job running in
5100 foreground. Useful for interactive commands like:
5101 ls | parallel -Xuj1 vi
5103 * GNU sql now supports SQLite.
5105 * Renamed .dburl.aliases to .sql/aliases and /etc/sql/aliases.
5107 * GNU sql now support --list-tables
5109 * Alias for DBURL can contain '?query' part with %-quoting.
5114 * Using --shebang GNU Parallel can be used as the parser for a script.
5115 E.g: #!/usr/bin/parallel --shebang traceroute (followed by lines of
5118 * First community generated bugfixes
5120 * Alt Linux package of GNU Parallel. Thanks to Michael Shigorin <mike
5121 at altlinux dot org>
5123 * Sunfreeware package of GNU Parallel. Thanks to Steven M. Christensen
5124 <sunfreeware at gmail.com>
5126 * Untested CentOS, Fedora, Mandriva, RedHat, and SUSE packages
5127 available through OpenSUSE build service:
5128 https://build.opensuse.org/package/show?package=parallel&project=home%3Atange
5130 * Review of GNU Parallel. Thanks to Andrew McFague amcfague at wgen dot net
5131 http://www.andrew-mcfague.com/linux/utilities-linux/
5132 commands-every-serious-nix-user-should-know/#parallel
5134 * First 1000 views of the intro video
5136 * sql - a small script to access sql bases from the command line which
5137 is a handy companion to parallel --colsep
5142 * Counting semaphore functionality: start a job in the background. If
5143 N jobs are already running, wait for one to complete. Examples:
5144 sem 'sleep 2; echo foo'; sem 'sleep 1; echo bar'; sem --wait
5145 sem -j2 'sleep 2; echo foo'; sem -j2 'sleep 1; echo bar'; sem --wait
5147 * With --colsep a table can be used as input. Example:
5148 cat tab_sep_table | parallel --colsep '\t' echo col1 {1} col2 {2}
5150 * --trim can remove white space around arguments.
5152 * --sshloginfile '..' means use ~/.parallel/sshloginfile
5154 * Zero install package. Thanks to Tim Cuthbertson <tim3d dot junk at
5157 * OpenSUSE package. Thanks to Markus Ammer <mkmm at gmx-topmail dot
5160 * NixOS package. Thanks to Ludovic Courtès <ludo at gnu dot org>
5162 * Web review http://oentend.blogspot.com/2010/08/gnu-parallel.html
5163 Thanks to Pavel Nuzhdin <pnzhdin at gmail dot com>
5165 * Web review http://psung.blogspot.com/2010/08/gnu-parallel.html
5166 Thanks to Phil Sung <psung at alum dot mit dot edu>
5171 * Arguments can now be given on the command line. Example:
5172 parallel bzip2 ::: *.txt
5174 * xapply like functionality. Example:
5175 parallel diff {1} {2} :::: filelist1 filelist2
5176 parallel diff {1} {2} ">"{1.}-{2.}.diff :::: filelist1 filelist2
5178 * Arch Linux package. Thanks to Peter Simons <simons at cryp dot to>
5180 * Mandriva package. Thanks to Sandro Cazzaniga <kharec at mandriva dot
5183 * -L -l -n -s now implies -X unless -m is set
5188 * New video showing the new options.
5189 http://www.youtube.com/watch?v=OpaiGYxkSuQ or at
5190 http://tinyogg.com/watch/TORaR/ and http://tinyogg.com/watch/hfxKj/
5192 * 100% options complete with xargs. All options for xargs can now be
5193 used in GNU Parallel - even the more exotic.
5195 * --basefile for transferring basedata. When running jobs on remote
5196 computers --basefile will transfer files before the first jobs is
5197 run. It can be used to transfer data that remains the same for each
5198 job such as scripts or lookup tables.
5200 * --progress shows progress. To see how many jobs is running on each
5201 server use --progress. It can be turned on even after GNU Parallel
5204 * --eta shows estimated time left in seconds.
5206 * --halt-on-error stops if an error occurs. GNU Parallel will default
5207 to run all jobs - even if some of them fail. With --halt-on-error
5208 GNU Parallel can ignore errors, wait for the currently running jobs
5209 to finish, or stop immediately when an error occurs.
5214 * GNU Parallel now has support for running jobs on remote machines
5216 * Intro video http://www.youtube.com/watch?v=LlXDtd_pRaY
5217 http://openvideo.dailymotion.com/video/xdmqwz_gnu-parallel-script-processing-and_tech
5222 * GNU Parallel is now official GNU software