ME_filter1.py is not working about microexonator HOT 3 OPEN

Hello,

Dependences are solved automatically by snakemake when you run it with --use-conda, this is why I am not providing the list of dependencies in the documentation. With this flag, snakemake creates the conda environments dynamically from the YAML files that are located at MicroExonator/envs/. In the particular case of ME_filter1.py uses pybedtools.yaml, take a look at this file and you will know which are the dependencies.

Looking at:

'source activate /data/MicroExonator/.snakemake/conda/f2d123d5; set -euo pipefail; python3 src/ME_filter1.py /data/resources/mouse/genome/GRCm38.p6.genome.fa Round1/Scnn_3_R2.sam.row_ME Round1/Scnn_3_R2.sam.row_ME.Genome.Aligned.out.sam data/GT_AG_U2_5.pwm data/GT_AG_U2_3.pwm /data/resources/mouse/PhastCons/mm10.60way.phastCons.bw 30 > Round1/Scnn_3_R2.sam.row_ME.filter1 '

I can see that snakemake successfully created the environment from pybedtools.yaml, you can try to activate this environment by using:

conda activate /data/MicroExonator/.snakemake/conda/f2d123d5

This should have all the dependencies installed.

What really caught my attention is that then snakemake tries to run the script with python3:

python3 src/ME_filter1.py /data/resources/mouse/genome/GRCm38.p6.genome.fa Round1/Scnn_3_R2.sam.row_ME Round1/Scnn_3_R2.sam.row_ME.Genome.Aligned.out.sam data/GT_AG_U2_5.pwm data/GT_AG_U2_3.pwm /data/resources/mouse/PhastCons/mm10.60way.phastCons.bw 30 > Round1/Scnn_3_R2.sam.row_ME.filter1

This should be run with python2, I am not sure why in your run python2 is not correctly called here. I will update conda in my machine and see if I also get this error. If this keeps causing problems, I can update all the code to python3, but it will take me a while. Could you perform a snakemake dry-run with -np and check if the command is generated for this step is using python3 instead of python2?

Thanks for reporting this,
Guillermo

from microexonator.

Hey,

thanks for the reply. I just reinstalled everything, removed Anaconda which was also installed, but I still get the following error messages:
Error in rule hisat2_Genome_index: rule download_fastq: input: download/VIP_W4_R2.download.sh output: FASTQ/VIP_W4_R2.fastq jobid: 800 wildcards: sample=VIP_W4_R2 priority: -10 resources: get_data=1 /usr/bin/bash: activate: No such file or directory jobid: 591
and later:
/usr/bin/bash: activate: No such file or directory RuleException: CalledProcessError in line 25 of /data/MicroExonator/rules/Round1_post_processing.skm: Command 'source activate /data/MicroExonator/.snakemake/conda/95f9e5c7; set -euo pipefail; hisat2-build /data/resources/mouse/genome/GRCm38.p6.genome.fa data/Genome ' returned non-zero exit status 127. File "/data/MicroExonator/rules/Round1_post_processing.skm", line 25, in __rule_hisat2_Genome_index File "/home/stephan/programs/miniconda3/envs/snakemake_env/lib/python3.6/concurrent/futures/thread.py", line 56, in run RuleException: CalledProcessError in line 31 of /data/MicroExonator/rules/Round2_post_processing.skm: Command 'source activate /data/MicroExonator/.snakemake/conda/95f9e5c7; set -euo pipefail; bowtie-build data/Genome data/Genome ' returned non-zero exit status 127. File "/data/MicroExonator/rules/Round2_post_processing.skm", line 31, in __rule_bowtie_Genome_index File "/home/stephan/programs/miniconda3/envs/snakemake_env/lib/python3.6/concurrent/futures/thread.py", line 56, in run

I used the same config file as before and ran the command:
snakemake -s MicroExonator.skm --use-conda -k -j 32

Everything is installed according to the provided manual. When I run the test command by adding the -np flag everything works without an error. Is there a way to fix this?

Best,
Stephan

from microexonator.

Sorry for the delay,

I think this is a bug with the Optimize_hard_drive : T feature. Now that we finally published MicroExonator on Genome Biology, I am going to be addressing the issues more actively. Please let me know if switching this to Optimize_hard_drive : F solves the issue so far (delete this line may also work).

I will close this issue once I manage to fix Optimize_hard_drive : T. I have now made a lot of changes to optimise the disk usage space in other ways, so this feature is not that relevant anymore, but I will still try to fix this soon.

Best,
Guillermo

from microexonator.