├── .gitignore ├── conda-forge.yml ├── .github ├── CODEOWNERS └── workflows │ ├── webservices.yml │ └── automerge.yml ├── .ci_support ├── linux_64_.yaml └── README ├── azure-pipelines.yml ├── .circleci └── config.yml ├── .gitattributes ├── recipe └── meta.yaml ├── .azure-pipelines └── azure-pipelines-linux.yml ├── LICENSE.txt ├── .scripts ├── build_steps.sh └── run_docker_build.sh └── README.md /.gitignore: -------------------------------------------------------------------------------- 1 | *.pyc 2 | 3 | build_artifacts 4 | -------------------------------------------------------------------------------- /conda-forge.yml: -------------------------------------------------------------------------------- 1 | conda_forge_output_validation: true 2 | -------------------------------------------------------------------------------- /.github/CODEOWNERS: -------------------------------------------------------------------------------- 1 | * @guillaumeeb @jhamman @lesteve @mrocklin -------------------------------------------------------------------------------- /.ci_support/linux_64_.yaml: -------------------------------------------------------------------------------- 1 | cdt_name: 2 | - cos6 3 | channel_sources: 4 | - conda-forge,defaults 5 | channel_targets: 6 | - conda-forge main 7 | docker_image: 8 | - quay.io/condaforge/linux-anvil-comp7 9 | -------------------------------------------------------------------------------- /.ci_support/README: -------------------------------------------------------------------------------- 1 | This file is automatically generated by conda-smithy. To change any matrix elements, you should change conda-smithy's input conda_build_config.yaml and re-render the recipe, rather than editing these files directly. -------------------------------------------------------------------------------- /azure-pipelines.yml: -------------------------------------------------------------------------------- 1 | # This file was generated automatically from conda-smithy. To update this configuration, 2 | # update the conda-forge.yml and/or the recipe/meta.yaml. 3 | # -*- mode: yaml -*- 4 | 5 | jobs: 6 | - template: ./.azure-pipelines/azure-pipelines-linux.yml -------------------------------------------------------------------------------- /.github/workflows/webservices.yml: -------------------------------------------------------------------------------- 1 | on: repository_dispatch 2 | 3 | jobs: 4 | webservices: 5 | runs-on: ubuntu-latest 6 | name: webservices 7 | steps: 8 | - name: webservices 9 | id: webservices 10 | uses: conda-forge/webservices-dispatch-action@master 11 | with: 12 | github_token: ${{ secrets.GITHUB_TOKEN }} 13 | -------------------------------------------------------------------------------- /.github/workflows/automerge.yml: -------------------------------------------------------------------------------- 1 | on: 2 | status: {} 3 | check_suite: 4 | types: 5 | - completed 6 | 7 | jobs: 8 | automerge-action: 9 | runs-on: ubuntu-latest 10 | name: automerge 11 | steps: 12 | - name: checkout 13 | uses: actions/checkout@v2 14 | - name: automerge-action 15 | id: automerge-action 16 | uses: conda-forge/automerge-action@master 17 | with: 18 | github_token: ${{ secrets.GITHUB_TOKEN }} 19 | -------------------------------------------------------------------------------- /.circleci/config.yml: -------------------------------------------------------------------------------- 1 | # This file was generated automatically from conda-smithy. To update this configuration, 2 | # update the conda-forge.yml and/or the recipe/meta.yaml. 3 | # -*- mode: yaml -*- 4 | 5 | version: 2 6 | 7 | jobs: 8 | build: 9 | working_directory: ~/test 10 | machine: true 11 | steps: 12 | - run: 13 | # The Circle-CI build should not be active, but if this is not true for some reason, do a fast finish. 14 | command: exit 0 15 | 16 | workflows: 17 | version: 2 18 | build_and_test: 19 | jobs: 20 | - build: 21 | filters: 22 | branches: 23 | ignore: 24 | - /.*/ 25 | -------------------------------------------------------------------------------- /.gitattributes: -------------------------------------------------------------------------------- 1 | * text=auto 2 | 3 | *.patch binary 4 | *.diff binary 5 | meta.yaml text eol=lf 6 | build.sh text eol=lf 7 | bld.bat text eol=crlf 8 | 9 | # github helper pieces to make some files not show up in diffs automatically 10 | .azure-pipelines/* linguist-generated=true 11 | .circleci/* linguist-generated=true 12 | .drone/* linguist-generated=true 13 | .drone.yml linguist-generated=true 14 | .github/* linguist-generated=true 15 | .travis/* linguist-generated=true 16 | .appveyor.yml linguist-generated=true 17 | .gitattributes linguist-generated=true 18 | .gitignore linguist-generated=true 19 | .travis.yml linguist-generated=true 20 | .scripts/* linguist-generated=true 21 | LICENSE.txt linguist-generated=true 22 | README.md linguist-generated=true 23 | azure-pipelines.yml linguist-generated=true 24 | build-locally.py linguist-generated=true 25 | shippable.yml linguist-generated=true 26 | -------------------------------------------------------------------------------- /recipe/meta.yaml: -------------------------------------------------------------------------------- 1 | {% set name = "dask-jobqueue" %} 2 | {% set version = "0.7.2" %} 3 | {% set sha256 = "1767f4146b2663d9d2eaef62b882a86e1df0bccdb8ae68ae3e5e546aa6796d35" %} 4 | 5 | package: 6 | name: {{ name|lower }} 7 | version: {{ version }} 8 | 9 | source: 10 | url: https://pypi.io/packages/source/{{ name[0] }}/{{ name }}/{{ name }}-{{ version }}.tar.gz 11 | sha256: {{ sha256 }} 12 | 13 | build: 14 | noarch: python 15 | number: 0 16 | script: {{ PYTHON }} -m pip install . --no-deps -vv 17 | 18 | requirements: 19 | host: 20 | - python >=3.5 21 | - pip 22 | run: 23 | - python >=3.5 24 | - dask-core >=2.5.2 25 | - distributed >=2.5.2 26 | 27 | test: 28 | imports: 29 | - dask_jobqueue 30 | 31 | about: 32 | home: https://github.com/dask/dask-jobqueue 33 | license: BSD-3-Clause 34 | license_family: BSD 35 | license_file: LICENSE.txt 36 | summary: Easy deployment of Dask Distributed on job queuing systems like PBS, Slurm, LSF and SGE. 37 | description: | 38 | Easy deployment of Dask Distributed on job queuing systems such as PBS, 39 | Slurm, LSF or SGE. 40 | doc_url: https://jobqueue.dask.org 41 | dev_url: https://github.com/dask/dask-jobqueue 42 | 43 | extra: 44 | recipe-maintainers: 45 | - jhamman 46 | - mrocklin 47 | - lesteve 48 | - guillaumeeb 49 | -------------------------------------------------------------------------------- /.azure-pipelines/azure-pipelines-linux.yml: -------------------------------------------------------------------------------- 1 | # This file was generated automatically from conda-smithy. To update this configuration, 2 | # update the conda-forge.yml and/or the recipe/meta.yaml. 3 | # -*- mode: yaml -*- 4 | 5 | jobs: 6 | - job: linux 7 | pool: 8 | vmImage: ubuntu-16.04 9 | strategy: 10 | matrix: 11 | linux_64_: 12 | CONFIG: linux_64_ 13 | UPLOAD_PACKAGES: 'True' 14 | DOCKER_IMAGE: quay.io/condaforge/linux-anvil-comp7 15 | timeoutInMinutes: 360 16 | 17 | steps: 18 | - script: | 19 | rm -rf /opt/ghc 20 | df -h 21 | displayName: Manage disk space 22 | 23 | # configure qemu binfmt-misc running. This allows us to run docker containers 24 | # embedded qemu-static 25 | - script: | 26 | docker run --rm --privileged multiarch/qemu-user-static:register --reset --credential yes 27 | ls /proc/sys/fs/binfmt_misc/ 28 | condition: not(startsWith(variables['CONFIG'], 'linux_64')) 29 | displayName: Configure binfmt_misc 30 | 31 | - script: | 32 | export CI=azure 33 | export GIT_BRANCH=$BUILD_SOURCEBRANCHNAME 34 | export FEEDSTOCK_NAME=$(basename ${BUILD_REPOSITORY_NAME}) 35 | .scripts/run_docker_build.sh 36 | displayName: Run docker build 37 | env: 38 | BINSTAR_TOKEN: $(BINSTAR_TOKEN) 39 | FEEDSTOCK_TOKEN: $(FEEDSTOCK_TOKEN) 40 | STAGING_BINSTAR_TOKEN: $(STAGING_BINSTAR_TOKEN) -------------------------------------------------------------------------------- /LICENSE.txt: -------------------------------------------------------------------------------- 1 | BSD 3-clause license 2 | Copyright (c) 2015-2020, conda-forge contributors 3 | All rights reserved. 4 | 5 | Redistribution and use in source and binary forms, with or without modification, are permitted provided that the following conditions are met: 6 | 7 | 1. Redistributions of source code must retain the above copyright notice, this list of conditions and the following disclaimer. 8 | 9 | 2. Redistributions in binary form must reproduce the above copyright notice, this list of conditions and the following disclaimer in the documentation and/or other materials provided with the distribution. 10 | 11 | 3. Neither the name of the copyright holder nor the names of its contributors may be used to endorse or promote products derived from this software without specific prior written permission. 12 | 13 | THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. 14 | -------------------------------------------------------------------------------- /.scripts/build_steps.sh: -------------------------------------------------------------------------------- 1 | #!/usr/bin/env bash 2 | 3 | # PLEASE NOTE: This script has been automatically generated by conda-smithy. Any changes here 4 | # will be lost next time ``conda smithy rerender`` is run. If you would like to make permanent 5 | # changes to this script, consider a proposal to conda-smithy so that other feedstocks can also 6 | # benefit from the improvement. 7 | 8 | set -xeuo pipefail 9 | export PYTHONUNBUFFERED=1 10 | export FEEDSTOCK_ROOT="${FEEDSTOCK_ROOT:-/home/conda/feedstock_root}" 11 | export RECIPE_ROOT="${RECIPE_ROOT:-/home/conda/recipe_root}" 12 | export CI_SUPPORT="${FEEDSTOCK_ROOT}/.ci_support" 13 | export CONFIG_FILE="${CI_SUPPORT}/${CONFIG}.yaml" 14 | 15 | cat >~/.condarc </dev/null && pwd )" 11 | PROVIDER_DIR="$(basename $THISDIR)" 12 | 13 | FEEDSTOCK_ROOT=$(cd "$(dirname "$0")/.."; pwd;) 14 | RECIPE_ROOT="${FEEDSTOCK_ROOT}/recipe" 15 | 16 | if [ -z ${FEEDSTOCK_NAME} ]; then 17 | export FEEDSTOCK_NAME=$(basename ${FEEDSTOCK_ROOT}) 18 | fi 19 | 20 | docker info 21 | 22 | # In order for the conda-build process in the container to write to the mounted 23 | # volumes, we need to run with the same id as the host machine, which is 24 | # normally the owner of the mounted volumes, or at least has write permission 25 | export HOST_USER_ID=$(id -u) 26 | # Check if docker-machine is being used (normally on OSX) and get the uid from 27 | # the VM 28 | if hash docker-machine 2> /dev/null && docker-machine active > /dev/null; then 29 | export HOST_USER_ID=$(docker-machine ssh $(docker-machine active) id -u) 30 | fi 31 | 32 | ARTIFACTS="$FEEDSTOCK_ROOT/build_artifacts" 33 | 34 | if [ -z "$CONFIG" ]; then 35 | set +x 36 | FILES=`ls .ci_support/linux_*` 37 | CONFIGS="" 38 | for file in $FILES; do 39 | CONFIGS="${CONFIGS}'${file:12:-5}' or "; 40 | done 41 | echo "Need to set CONFIG env variable. Value can be one of ${CONFIGS:0:-4}" 42 | exit 1 43 | fi 44 | 45 | if [ -z "${DOCKER_IMAGE}" ]; then 46 | SHYAML_INSTALLED="$(shyaml -h || echo NO)" 47 | if [ "${SHYAML_INSTALLED}" == "NO" ]; then 48 | echo "WARNING: DOCKER_IMAGE variable not set and shyaml not installed. Falling back to condaforge/linux-anvil-comp7" 49 | DOCKER_IMAGE="condaforge/linux-anvil-comp7" 50 | else 51 | DOCKER_IMAGE="$(cat "${FEEDSTOCK_ROOT}/.ci_support/${CONFIG}.yaml" | shyaml get-value docker_image.0 condaforge/linux-anvil-comp7 )" 52 | fi 53 | fi 54 | 55 | mkdir -p "$ARTIFACTS" 56 | DONE_CANARY="$ARTIFACTS/conda-forge-build-done-${CONFIG}" 57 | rm -f "$DONE_CANARY" 58 | 59 | # Allow people to specify extra default arguments to `docker run` (e.g. `--rm`) 60 | DOCKER_RUN_ARGS="${CONDA_FORGE_DOCKER_RUN_ARGS}" 61 | if [ -z "${CI}" ]; then 62 | DOCKER_RUN_ARGS="-it ${DOCKER_RUN_ARGS}" 63 | fi 64 | 65 | export UPLOAD_PACKAGES="${UPLOAD_PACKAGES:-True}" 66 | docker run ${DOCKER_RUN_ARGS} \ 67 | -v "${RECIPE_ROOT}":/home/conda/recipe_root:rw,z \ 68 | -v "${FEEDSTOCK_ROOT}":/home/conda/feedstock_root:rw,z \ 69 | -e CONFIG \ 70 | -e HOST_USER_ID \ 71 | -e UPLOAD_PACKAGES \ 72 | -e GIT_BRANCH \ 73 | -e UPLOAD_ON_BRANCH \ 74 | -e CI \ 75 | -e FEEDSTOCK_NAME \ 76 | -e CPU_COUNT \ 77 | -e BUILD_WITH_CONDA_DEBUG \ 78 | -e BUILD_OUTPUT_ID \ 79 | -e BINSTAR_TOKEN \ 80 | -e FEEDSTOCK_TOKEN \ 81 | -e STAGING_BINSTAR_TOKEN \ 82 | $DOCKER_IMAGE \ 83 | bash \ 84 | /home/conda/feedstock_root/${PROVIDER_DIR}/build_steps.sh 85 | 86 | # verify that the end of the script was reached 87 | test -f "$DONE_CANARY" -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- 1 | About dask-jobqueue 2 | =================== 3 | 4 | Home: https://github.com/dask/dask-jobqueue 5 | 6 | Package license: BSD-3-Clause 7 | 8 | Feedstock license: [BSD-3-Clause](https://github.com/conda-forge/dask-jobqueue-feedstock/blob/master/LICENSE.txt) 9 | 10 | Summary: Easy deployment of Dask Distributed on job queuing systems like PBS, Slurm, LSF and SGE. 11 | 12 | Development: https://github.com/dask/dask-jobqueue 13 | 14 | Documentation: https://jobqueue.dask.org 15 | 16 | Easy deployment of Dask Distributed on job queuing systems such as PBS, 17 | Slurm, LSF or SGE. 18 | 19 | 20 | Current build status 21 | ==================== 22 | 23 | 24 | 25 | 30 | 31 |
All platforms: 26 | 27 | 28 | 29 |
32 | 33 | Current release info 34 | ==================== 35 | 36 | | Name | Downloads | Version | Platforms | 37 | | --- | --- | --- | --- | 38 | | [![Conda Recipe](https://img.shields.io/badge/recipe-dask--jobqueue-green.svg)](https://anaconda.org/conda-forge/dask-jobqueue) | [![Conda Downloads](https://img.shields.io/conda/dn/conda-forge/dask-jobqueue.svg)](https://anaconda.org/conda-forge/dask-jobqueue) | [![Conda Version](https://img.shields.io/conda/vn/conda-forge/dask-jobqueue.svg)](https://anaconda.org/conda-forge/dask-jobqueue) | [![Conda Platforms](https://img.shields.io/conda/pn/conda-forge/dask-jobqueue.svg)](https://anaconda.org/conda-forge/dask-jobqueue) | 39 | 40 | Installing dask-jobqueue 41 | ======================== 42 | 43 | Installing `dask-jobqueue` from the `conda-forge` channel can be achieved by adding `conda-forge` to your channels with: 44 | 45 | ``` 46 | conda config --add channels conda-forge 47 | ``` 48 | 49 | Once the `conda-forge` channel has been enabled, `dask-jobqueue` can be installed with: 50 | 51 | ``` 52 | conda install dask-jobqueue 53 | ``` 54 | 55 | It is possible to list all of the versions of `dask-jobqueue` available on your platform with: 56 | 57 | ``` 58 | conda search dask-jobqueue --channel conda-forge 59 | ``` 60 | 61 | 62 | About conda-forge 63 | ================= 64 | 65 | [![Powered by NumFOCUS](https://img.shields.io/badge/powered%20by-NumFOCUS-orange.svg?style=flat&colorA=E1523D&colorB=007D8A)](http://numfocus.org) 66 | 67 | conda-forge is a community-led conda channel of installable packages. 68 | In order to provide high-quality builds, the process has been automated into the 69 | conda-forge GitHub organization. The conda-forge organization contains one repository 70 | for each of the installable packages. Such a repository is known as a *feedstock*. 71 | 72 | A feedstock is made up of a conda recipe (the instructions on what and how to build 73 | the package) and the necessary configurations for automatic building using freely 74 | available continuous integration services. Thanks to the awesome service provided by 75 | [CircleCI](https://circleci.com/), [AppVeyor](https://www.appveyor.com/) 76 | and [TravisCI](https://travis-ci.com/) it is possible to build and upload installable 77 | packages to the [conda-forge](https://anaconda.org/conda-forge) 78 | [Anaconda-Cloud](https://anaconda.org/) channel for Linux, Windows and OSX respectively. 79 | 80 | To manage the continuous integration and simplify feedstock maintenance 81 | [conda-smithy](https://github.com/conda-forge/conda-smithy) has been developed. 82 | Using the ``conda-forge.yml`` within this repository, it is possible to re-render all of 83 | this feedstock's supporting files (e.g. the CI configuration files) with ``conda smithy rerender``. 84 | 85 | For more information please check the [conda-forge documentation](https://conda-forge.org/docs/). 86 | 87 | Terminology 88 | =========== 89 | 90 | **feedstock** - the conda recipe (raw material), supporting scripts and CI configuration. 91 | 92 | **conda-smithy** - the tool which helps orchestrate the feedstock. 93 | Its primary use is in the construction of the CI ``.yml`` files 94 | and simplify the management of *many* feedstocks. 95 | 96 | **conda-forge** - the place where the feedstock and smithy live and work to 97 | produce the finished article (built conda distributions) 98 | 99 | 100 | Updating dask-jobqueue-feedstock 101 | ================================ 102 | 103 | If you would like to improve the dask-jobqueue recipe or build a new 104 | package version, please fork this repository and submit a PR. Upon submission, 105 | your changes will be run on the appropriate platforms to give the reviewer an 106 | opportunity to confirm that the changes result in a successful build. Once 107 | merged, the recipe will be re-built and uploaded automatically to the 108 | `conda-forge` channel, whereupon the built conda packages will be available for 109 | everybody to install and use from the `conda-forge` channel. 110 | Note that all branches in the conda-forge/dask-jobqueue-feedstock are 111 | immediately built and any created packages are uploaded, so PRs should be based 112 | on branches in forks and branches in the main repository should only be used to 113 | build distinct package versions. 114 | 115 | In order to produce a uniquely identifiable distribution: 116 | * If the version of a package **is not** being increased, please add or increase 117 | the [``build/number``](https://conda.io/docs/user-guide/tasks/build-packages/define-metadata.html#build-number-and-string). 118 | * If the version of a package **is** being increased, please remember to return 119 | the [``build/number``](https://conda.io/docs/user-guide/tasks/build-packages/define-metadata.html#build-number-and-string) 120 | back to 0. 121 | 122 | Feedstock Maintainers 123 | ===================== 124 | 125 | * [@guillaumeeb](https://github.com/guillaumeeb/) 126 | * [@jhamman](https://github.com/jhamman/) 127 | * [@lesteve](https://github.com/lesteve/) 128 | * [@mrocklin](https://github.com/mrocklin/) 129 | 130 | --------------------------------------------------------------------------------