Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

question: SFTP options #2835

Open
SanVerb opened this issue Apr 22, 2024 · 0 comments
Open

question: SFTP options #2835

SanVerb opened this issue Apr 22, 2024 · 0 comments

Comments

@SanVerb
Copy link

SanVerb commented Apr 22, 2024

Hello

I'm trying to understand how to make use of storage provider to acces files on a remote server via SFTP.

profile file:

---
#restart-times: 1
max-jobs-per-second: 1
max-status-checks-per-second: 10
cores: 8 #
rerun-incomplete: true
keep-going: true
use-conda: true
# use-singularity: true
rerun-triggers: mtime # jobs will be rerun if their input files have been modified since the last run.
dry-run: true
# debug-dag: true
# verbose: true

default-storage-provider: sftp
storage-sftp-username: **********
storage-sftp-password: ***************

my test code:

import pandas as pd
import os
import time
import yaml
import pysftp

rule test:
    input:
        storage.sftp('sftp://***.***.**.***/home/**********/DEEMPRINT/workflow/data/inputdata/SAF/SAF.txt')
    shell:
        '''
        exec > {log} 2> {log}
        set -e
        echo "hello world"
        '''

"...*"/ -> IP address server
**********/ -> username

I always get the following error:

TypeError in file /home/snache/DEEMPRINT/workflow/snakefile, line 9:
'NoneType' object cannot be interpreted as an integer
  File "/home/********/miniconda3/envs/DEEMPRINT_snakemake/lib/python3.12/site-packages/pysftp/__init__.py", line 140, in __init__
  File "/home/********/miniconda3/envs/DEEMPRINT_snakemake/lib/python3.12/site-packages/pysftp/__init__.py", line 176, in _start_transport
  File "/home/********/miniconda3/envs/DEEMPRINT_snakemake/lib/python3.12/site-packages/paramiko/transport.py", line 458, in __init__

I believe I'm giving incorrect information after storage.sftp, but I'm not sure as to what I need to change.

Kind regard

Sanché Verbeeck

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant