Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Nbconvert >= 7.14 produces error in Sphinx build #2092

Open
matteobachetti opened this issue Jan 2, 2024 · 13 comments
Open

Nbconvert >= 7.14 produces error in Sphinx build #2092

matteobachetti opened this issue Jan 2, 2024 · 13 comments

Comments

@matteobachetti
Copy link

In Stingray, we build documentation from a bunch of rst files and a number of notebooks. It usually works quite well, but today I'm having errors like the ones in the build below:

https://github.com/StingraySoftware/stingray/actions/runs/7384306812/job/20086984844#step:8:511

The critical message is the following:

"Content block expected for the "raw" directive; none found."

However, I don't know where this raw directive is, it's probably in the rst file that is being produced internally from the notebook.
The errors disappear if I fix the nbconvert version to <7.14.

Thanks in advance for any help

@blink1073
Copy link
Member

Hi @matteobachetti, to be clear, it works with 7.13.1? I don't see anything in the 7.14 release itself that looks relevant.

@matteobachetti
Copy link
Author

Yep, you can see here that nbconvert fixed to <7.14 (it uses 7.13.1) does not produce the issue. But I'm not sure there are no other dependencies that are influenced by this.
https://github.com/StingraySoftware/stingray/actions/runs/7388419796/job/20099216748

@matteobachetti
Copy link
Author

matteobachetti commented Jan 3, 2024

@blink1073 is there a way to debug this? If I could access the rst files produced by nbconvert, for example, I could look at exactly what lines are producing the raw directive.

@blink1073
Copy link
Member

Unfortunately not, based on looking at spatialaudio/nbsphinx#620.

What you can do is test the specific commits:

nbconvert: git+https://github.com/jupyter/nbconvert.git@a3a069c9a10bb011911166c0f84b9edb1fef305d

The commits we're interested in are:

15625319f6bd7917df8ec891795411554e0015bd
a3a069c9a10bb011911166c0f84b9edb1fef305d
ece13fd22d96fda9cde06534e265bc5fe3fc4c80
0f17b3069d320565af12a4a12da7d9ce3c18dac4
b1715cdae9b4b51c1797a63a7045660145d36aac

@danking
Copy link

danking commented Feb 2, 2024

We ran into this as well. I can't seem to replicate on my Mac, it only occurs in Linux containers in our CI system. We pin the requirements, so, modulo OS differences, I should have the same packages as the CI system.

Example failing notebook: https://github.com/danking/hail/blob/update-deps/hail/python/hail/docs/tutorials/06-joins.ipynb
Our pinned-requirements: https://github.com/danking/hail/blob/update-deps/hail/python/dev/pinned-requirements.txt

The code we run follows, but I've updated the paths to make sense from the root of the Hail repository. The Makefile in hail/python/hail/docs is here.

set -o pipefail
export SPHINXOPTS='-tgenerate_notebook_outputs'

make -C hail install python/hail/docs/change_log.rst
make -C hail/python/hail/docs BUILDDIR=_build clean html

I ran the code from #620 to generate RST from the ipynb and then copied that RST file into my docs and built the docs (on my Mac, which hasn't failed yet) and it seems to have built fine. The generated RST is here.

I'm a bit at a loss about how to move forward.

The log from a CI build showing the errors
+ set -o pipefail
+ export HAIL_SHORT_VERSION=0.2
+ HAIL_SHORT_VERSION=0.2
+ export SPHINXOPTS=-tgenerate_notebook_outputs
+ SPHINXOPTS=-tgenerate_notebook_outputs
+ python3 -m pip install --no-dependencies /io/wheel/hail-0.2.127-py3-none-any.whl
Processing /io/wheel/hail-0.2.127-py3-none-any.whl
Installing collected packages: hail
Successfully installed hail-0.2.127
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv

[notice] A new release of pip is available: 23.3.1 -> 23.3.2
[notice] To update, run: python3 -m pip install --upgrade pip
+ cd /io/hail
+ export HAIL_WEBSITE_DIR=/io/website/website/
+ HAIL_WEBSITE_DIR=/io/website/website/
+ sed -E 's/\(hail\#([0-9]+)\)/(\[#\1](https:\/\/github.com\/hail-is\/hail\/pull\/\1))/g'
+ pandoc -o python/hail/docs/change_log.rst --fail-if-warnings --verbose
[INFO] Not rendering RawInline (Format "html") "<NON_REF>"
+ make -C python/hail/docs BUILDDIR=_build clean html
make: Entering directory '/io/hail/python/hail/docs'
rm -rf _build
python3 -msphinx -T -b html -d _build/doctrees  -tgenerate_notebook_outputs  -W --keep-going  . _build/html
Running Sphinx v6.2.1
[autosummary] generating autosummary for: aggregators.rst, annotation_database_ui.rst, api.rst, batch_api.rst, change_log.rst, cheatsheets.rst, cloud/amazon_web_services.rst, cloud/azure.rst, cloud/databricks.rst, cloud/general_advice.rst, ..., tutorials/03-tables.ipynb, tutorials/04-aggregation.ipynb, tutorials/05-filter-annotate.ipynb, tutorials/06-joins.ipynb, tutorials/07-matrixtable.ipynb, tutorials/08-plotting.ipynb, tutorials/09-ggplot.ipynb, types.rst, utils/index.rst, vds/index.rst
[autosummary] generating autosummary for: /io/hail/python/hail/docs/experimental/hail.experimental.DB.rst, /io/hail/python/hail/docs/functions/hail.expr.builders.CaseBuilder.rst, /io/hail/python/hail/docs/functions/hail.expr.builders.SwitchBuilder.rst, /io/hail/python/hail/docs/genetics/hail.genetics.Call.rst, /io/hail/python/hail/docs/genetics/hail.genetics.Locus.rst, /io/hail/python/hail/docs/genetics/hail.genetics.Pedigree.rst, /io/hail/python/hail/docs/genetics/hail.genetics.ReferenceGenome.rst, /io/hail/python/hail/docs/genetics/hail.genetics.Trio.rst, /io/hail/python/hail/docs/hail.GroupedMatrixTable.rst, /io/hail/python/hail/docs/hail.GroupedTable.rst, ..., /io/hail/python/hail/docs/vds/hail.vds.lgt_to_gt.rst, /io/hail/python/hail/docs/vds/hail.vds.local_to_global.rst, /io/hail/python/hail/docs/vds/hail.vds.merge_reference_blocks.rst, /io/hail/python/hail/docs/vds/hail.vds.read_vds.rst, /io/hail/python/hail/docs/vds/hail.vds.sample_qc.rst, /io/hail/python/hail/docs/vds/hail.vds.split_multi.rst, /io/hail/python/hail/docs/vds/hail.vds.store_ref_block_max_length.rst, /io/hail/python/hail/docs/vds/hail.vds.to_dense_mt.rst, /io/hail/python/hail/docs/vds/hail.vds.to_merged_sparse_mt.rst, /io/hail/python/hail/docs/vds/hail.vds.truncate_reference_blocks.rst
loading intersphinx inventory from https://docs.python.org/3.9/objects.inv...
loading intersphinx inventory from https://spark.apache.org/docs/latest/api/python/objects.inv...
loading intersphinx inventory from https://docs.bokeh.org/en/3.1.0/objects.inv...
loading intersphinx inventory from https://numpy.org/doc/stable/objects.inv...
loading intersphinx inventory from https://docs.scipy.org/doc/scipy-1.9.3/objects.inv...
loading intersphinx inventory from https://pandas.pydata.org/docs/objects.inv...
building [mo]: targets for 0 po files that are out of date
writing output... 
building [html]: targets for 290 source files that are out of date
updating environment: [new config] 346 added, 0 changed, 0 removed
reading sources... [  0%] aggregators
reading sources... [  0%] annotation_database_ui
reading sources... [  0%] api
reading sources... [  1%] batch_api
reading sources... [  1%] change_log
reading sources... [  1%] cheatsheets
reading sources... [  2%] cloud/amazon_web_services
reading sources... [  2%] cloud/azure
reading sources... [  2%] cloud/databricks
reading sources... [  2%] cloud/general_advice
reading sources... [  3%] cloud/google_cloud
reading sources... [  3%] cloud/query_on_batch
reading sources... [  3%] configuration_reference
reading sources... [  4%] datasets
reading sources... [  4%] datasets/schemas
reading sources... [  4%] datasets/schemas/1000_Genomes_HighCov_autosomes
reading sources... [  4%] datasets/schemas/1000_Genomes_HighCov_chrX
reading sources... [  5%] datasets/schemas/1000_Genomes_HighCov_chrY
reading sources... [  5%] datasets/schemas/1000_Genomes_Retracted_autosomes
reading sources... [  5%] datasets/schemas/1000_Genomes_Retracted_chrX
reading sources... [  6%] datasets/schemas/1000_Genomes_Retracted_chrY
reading sources... [  6%] datasets/schemas/1000_Genomes_autosomes
reading sources... [  6%] datasets/schemas/1000_Genomes_chrMT
reading sources... [  6%] datasets/schemas/1000_Genomes_chrX
reading sources... [  7%] datasets/schemas/1000_Genomes_chrY
reading sources... [  7%] datasets/schemas/CADD
reading sources... [  7%] datasets/schemas/DANN
reading sources... [  8%] datasets/schemas/Ensembl_homo_sapiens_low_complexity_regions
reading sources... [  8%] datasets/schemas/Ensembl_homo_sapiens_reference_genome
reading sources... [  8%] datasets/schemas/GTEx_RNA_seq_gene_TPMs
reading sources... [  8%] datasets/schemas/GTEx_RNA_seq_gene_read_counts
reading sources... [  9%] datasets/schemas/GTEx_RNA_seq_junction_read_counts
reading sources... [  9%] datasets/schemas/GTEx_eQTL_Adipose_Subcutaneous_all_snp_gene_associations
reading sources... [  9%] datasets/schemas/GTEx_eQTL_Adipose_Visceral_Omentum_all_snp_gene_associations
reading sources... [ 10%] datasets/schemas/GTEx_eQTL_Adrenal_Gland_all_snp_gene_associations
reading sources... [ 10%] datasets/schemas/GTEx_eQTL_Artery_Aorta_all_snp_gene_associations
reading sources... [ 10%] datasets/schemas/GTEx_eQTL_Artery_Coronary_all_snp_gene_associations
reading sources... [ 10%] datasets/schemas/GTEx_eQTL_Artery_Tibial_all_snp_gene_associations
reading sources... [ 11%] datasets/schemas/GTEx_eQTL_Brain_Amygdala_all_snp_gene_associations
reading sources... [ 11%] datasets/schemas/GTEx_eQTL_Brain_Anterior_cingulate_cortex_BA24_all_snp_gene_associations
reading sources... [ 11%] datasets/schemas/GTEx_eQTL_Brain_Caudate_basal_ganglia_all_snp_gene_associations
reading sources... [ 12%] datasets/schemas/GTEx_eQTL_Brain_Cerebellar_Hemisphere_all_snp_gene_associations
reading sources... [ 12%] datasets/schemas/GTEx_eQTL_Brain_Cerebellum_all_snp_gene_associations
reading sources... [ 12%] datasets/schemas/GTEx_eQTL_Brain_Cortex_all_snp_gene_associations
reading sources... [ 13%] datasets/schemas/GTEx_eQTL_Brain_Frontal_Cortex_BA9_all_snp_gene_associations
reading sources... [ 13%] datasets/schemas/GTEx_eQTL_Brain_Hippocampus_all_snp_gene_associations
reading sources... [ 13%] datasets/schemas/GTEx_eQTL_Brain_Hypothalamus_all_snp_gene_associations
reading sources... [ 13%] datasets/schemas/GTEx_eQTL_Brain_Nucleus_accumbens_basal_ganglia_all_snp_gene_associations
reading sources... [ 14%] datasets/schemas/GTEx_eQTL_Brain_Putamen_basal_ganglia_all_snp_gene_associations
reading sources... [ 14%] datasets/schemas/GTEx_eQTL_Brain_Spinal_cord_cervical_c-1_all_snp_gene_associations
reading sources... [ 14%] datasets/schemas/GTEx_eQTL_Brain_Substantia_nigra_all_snp_gene_associations
reading sources... [ 15%] datasets/schemas/GTEx_eQTL_Breast_Mammary_Tissue_all_snp_gene_associations
reading sources... [ 15%] datasets/schemas/GTEx_eQTL_Cells_Cultured_fibroblasts_all_snp_gene_associations
reading sources... [ 15%] datasets/schemas/GTEx_eQTL_Cells_EBV-transformed_lymphocytes_all_snp_gene_associations
reading sources... [ 15%] datasets/schemas/GTEx_eQTL_Colon_Sigmoid_all_snp_gene_associations
reading sources... [ 16%] datasets/schemas/GTEx_eQTL_Colon_Transverse_all_snp_gene_associations
reading sources... [ 16%] datasets/schemas/GTEx_eQTL_Esophagus_Gastroesophageal_Junction_all_snp_gene_associations
reading sources... [ 16%] datasets/schemas/GTEx_eQTL_Esophagus_Mucosa_all_snp_gene_associations
reading sources... [ 17%] datasets/schemas/GTEx_eQTL_Esophagus_Muscularis_all_snp_gene_associations
reading sources... [ 17%] datasets/schemas/GTEx_eQTL_Heart_Atrial_Appendage_all_snp_gene_associations
reading sources... [ 17%] datasets/schemas/GTEx_eQTL_Heart_Left_Ventricle_all_snp_gene_associations
reading sources... [ 17%] datasets/schemas/GTEx_eQTL_Kidney_Cortex_all_snp_gene_associations
reading sources... [ 18%] datasets/schemas/GTEx_eQTL_Liver_all_snp_gene_associations
reading sources... [ 18%] datasets/schemas/GTEx_eQTL_Lung_all_snp_gene_associations
reading sources... [ 18%] datasets/schemas/GTEx_eQTL_Minor_Salivary_Gland_all_snp_gene_associations
reading sources... [ 19%] datasets/schemas/GTEx_eQTL_Muscle_Skeletal_all_snp_gene_associations
reading sources... [ 19%] datasets/schemas/GTEx_eQTL_Nerve_Tibial_all_snp_gene_associations
reading sources... [ 19%] datasets/schemas/GTEx_eQTL_Ovary_all_snp_gene_associations
reading sources... [ 19%] datasets/schemas/GTEx_eQTL_Pancreas_all_snp_gene_associations
reading sources... [ 20%] datasets/schemas/GTEx_eQTL_Pituitary_all_snp_gene_associations
reading sources... [ 20%] datasets/schemas/GTEx_eQTL_Prostate_all_snp_gene_associations
reading sources... [ 20%] datasets/schemas/GTEx_eQTL_Skin_Not_Sun_Exposed_Suprapubic_all_snp_gene_associations
reading sources... [ 21%] datasets/schemas/GTEx_eQTL_Skin_Sun_Exposed_Lower_leg_all_snp_gene_associations
reading sources... [ 21%] datasets/schemas/GTEx_eQTL_Small_Intestine_Terminal_Ileum_all_snp_gene_associations
reading sources... [ 21%] datasets/schemas/GTEx_eQTL_Spleen_all_snp_gene_associations
reading sources... [ 21%] datasets/schemas/GTEx_eQTL_Stomach_all_snp_gene_associations
reading sources... [ 22%] datasets/schemas/GTEx_eQTL_Testis_all_snp_gene_associations
reading sources... [ 22%] datasets/schemas/GTEx_eQTL_Thyroid_all_snp_gene_associations
reading sources... [ 22%] datasets/schemas/GTEx_eQTL_Uterus_all_snp_gene_associations
reading sources... [ 23%] datasets/schemas/GTEx_eQTL_Vagina_all_snp_gene_associations
reading sources... [ 23%] datasets/schemas/GTEx_eQTL_Whole_Blood_all_snp_gene_associations
reading sources... [ 23%] datasets/schemas/GTEx_eQTL_all_snp_gene_associations
reading sources... [ 23%] datasets/schemas/GTEx_sQTL_Adipose_Subcutaneous_all_snp_gene_associations
reading sources... [ 24%] datasets/schemas/GTEx_sQTL_Adipose_Visceral_Omentum_all_snp_gene_associations
reading sources... [ 24%] datasets/schemas/GTEx_sQTL_Adrenal_Gland_all_snp_gene_associations
reading sources... [ 24%] datasets/schemas/GTEx_sQTL_Artery_Aorta_all_snp_gene_associations
reading sources... [ 25%] datasets/schemas/GTEx_sQTL_Artery_Coronary_all_snp_gene_associations
reading sources... [ 25%] datasets/schemas/GTEx_sQTL_Artery_Tibial_all_snp_gene_associations
reading sources... [ 25%] datasets/schemas/GTEx_sQTL_Brain_Amygdala_all_snp_gene_associations
reading sources... [ 26%] datasets/schemas/GTEx_sQTL_Brain_Anterior_cingulate_cortex_BA24_all_snp_gene_associations
reading sources... [ 26%] datasets/schemas/GTEx_sQTL_Brain_Caudate_basal_ganglia_all_snp_gene_associations
reading sources... [ 26%] datasets/schemas/GTEx_sQTL_Brain_Cerebellar_Hemisphere_all_snp_gene_associations
reading sources... [ 26%] datasets/schemas/GTEx_sQTL_Brain_Cerebellum_all_snp_gene_associations
reading sources... [ 27%] datasets/schemas/GTEx_sQTL_Brain_Cortex_all_snp_gene_associations
reading sources... [ 27%] datasets/schemas/GTEx_sQTL_Brain_Frontal_Cortex_BA9_all_snp_gene_associations
reading sources... [ 27%] datasets/schemas/GTEx_sQTL_Brain_Hippocampus_all_snp_gene_associations
reading sources... [ 28%] datasets/schemas/GTEx_sQTL_Brain_Hypothalamus_all_snp_gene_associations
reading sources... [ 28%] datasets/schemas/GTEx_sQTL_Brain_Nucleus_accumbens_basal_ganglia_all_snp_gene_associations
reading sources... [ 28%] datasets/schemas/GTEx_sQTL_Brain_Putamen_basal_ganglia_all_snp_gene_associations
reading sources... [ 28%] datasets/schemas/GTEx_sQTL_Brain_Spinal_cord_cervical_c-1_all_snp_gene_associations
reading sources... [ 29%] datasets/schemas/GTEx_sQTL_Brain_Substantia_nigra_all_snp_gene_associations
reading sources... [ 29%] datasets/schemas/GTEx_sQTL_Breast_Mammary_Tissue_all_snp_gene_associations
reading sources... [ 29%] datasets/schemas/GTEx_sQTL_Cells_Cultured_fibroblasts_all_snp_gene_associations
reading sources... [ 30%] datasets/schemas/GTEx_sQTL_Cells_EBV-transformed_lymphocytes_all_snp_gene_associations
reading sources... [ 30%] datasets/schemas/GTEx_sQTL_Colon_Sigmoid_all_snp_gene_associations
reading sources... [ 30%] datasets/schemas/GTEx_sQTL_Colon_Transverse_all_snp_gene_associations
reading sources... [ 30%] datasets/schemas/GTEx_sQTL_Esophagus_Gastroesophageal_Junction_all_snp_gene_associations
reading sources... [ 31%] datasets/schemas/GTEx_sQTL_Esophagus_Mucosa_all_snp_gene_associations
reading sources... [ 31%] datasets/schemas/GTEx_sQTL_Esophagus_Muscularis_all_snp_gene_associations
reading sources... [ 31%] datasets/schemas/GTEx_sQTL_Heart_Atrial_Appendage_all_snp_gene_associations
reading sources... [ 32%] datasets/schemas/GTEx_sQTL_Heart_Left_Ventricle_all_snp_gene_associations
reading sources... [ 32%] datasets/schemas/GTEx_sQTL_Kidney_Cortex_all_snp_gene_associations
reading sources... [ 32%] datasets/schemas/GTEx_sQTL_Liver_all_snp_gene_associations
reading sources... [ 32%] datasets/schemas/GTEx_sQTL_Lung_all_snp_gene_associations
reading sources... [ 33%] datasets/schemas/GTEx_sQTL_Minor_Salivary_Gland_all_snp_gene_associations
reading sources... [ 33%] datasets/schemas/GTEx_sQTL_Muscle_Skeletal_all_snp_gene_associations
reading sources... [ 33%] datasets/schemas/GTEx_sQTL_Nerve_Tibial_all_snp_gene_associations
reading sources... [ 34%] datasets/schemas/GTEx_sQTL_Ovary_all_snp_gene_associations
reading sources... [ 34%] datasets/schemas/GTEx_sQTL_Pancreas_all_snp_gene_associations
reading sources... [ 34%] datasets/schemas/GTEx_sQTL_Pituitary_all_snp_gene_associations
reading sources... [ 34%] datasets/schemas/GTEx_sQTL_Prostate_all_snp_gene_associations
reading sources... [ 35%] datasets/schemas/GTEx_sQTL_Skin_Not_Sun_Exposed_Suprapubic_all_snp_gene_associations
reading sources... [ 35%] datasets/schemas/GTEx_sQTL_Skin_Sun_Exposed_Lower_leg_all_snp_gene_associations
reading sources... [ 35%] datasets/schemas/GTEx_sQTL_Small_Intestine_Terminal_Ileum_all_snp_gene_associations
reading sources... [ 36%] datasets/schemas/GTEx_sQTL_Spleen_all_snp_gene_associations
reading sources... [ 36%] datasets/schemas/GTEx_sQTL_Stomach_all_snp_gene_associations
reading sources... [ 36%] datasets/schemas/GTEx_sQTL_Testis_all_snp_gene_associations
reading sources... [ 36%] datasets/schemas/GTEx_sQTL_Thyroid_all_snp_gene_associations
reading sources... [ 37%] datasets/schemas/GTEx_sQTL_Uterus_all_snp_gene_associations
reading sources... [ 37%] datasets/schemas/GTEx_sQTL_Vagina_all_snp_gene_associations
reading sources... [ 37%] datasets/schemas/GTEx_sQTL_Whole_Blood_all_snp_gene_associations
reading sources... [ 38%] datasets/schemas/UK_Biobank_Rapid_GWAS_both_sexes
reading sources... [ 38%] datasets/schemas/UK_Biobank_Rapid_GWAS_female
reading sources... [ 38%] datasets/schemas/UK_Biobank_Rapid_GWAS_male
reading sources... [ 39%] datasets/schemas/clinvar_gene_summary
reading sources... [ 39%] datasets/schemas/clinvar_variant_summary
reading sources... [ 39%] datasets/schemas/dbNSFP_genes
reading sources... [ 39%] datasets/schemas/dbNSFP_variants
reading sources... [ 40%] datasets/schemas/dbSNP
reading sources... [ 40%] datasets/schemas/dbSNP_rsid
reading sources... [ 40%] datasets/schemas/gencode
reading sources... [ 41%] datasets/schemas/gerp_elements
reading sources... [ 41%] datasets/schemas/gerp_scores
reading sources... [ 41%] datasets/schemas/giant_bmi_exome_AFR
reading sources... [ 41%] datasets/schemas/giant_bmi_exome_ALL
reading sources... [ 42%] datasets/schemas/giant_bmi_exome_AMR
reading sources... [ 42%] datasets/schemas/giant_bmi_exome_EAS
reading sources... [ 42%] datasets/schemas/giant_bmi_exome_EUR
reading sources... [ 43%] datasets/schemas/giant_bmi_exome_SAS
reading sources... [ 43%] datasets/schemas/giant_height_exome_AFR
reading sources... [ 43%] datasets/schemas/giant_height_exome_ALL
reading sources... [ 43%] datasets/schemas/giant_height_exome_AMR
reading sources... [ 44%] datasets/schemas/giant_height_exome_EAS
reading sources... [ 44%] datasets/schemas/giant_height_exome_EUR
reading sources... [ 44%] datasets/schemas/giant_height_exome_SAS
reading sources... [ 45%] datasets/schemas/giant_whr_exome_C_ALL_Add
reading sources... [ 45%] datasets/schemas/giant_whr_exome_C_ALL_Rec
reading sources... [ 45%] datasets/schemas/giant_whr_exome_C_EUR_Add
reading sources... [ 45%] datasets/schemas/giant_whr_exome_C_EUR_Rec
reading sources... [ 46%] datasets/schemas/giant_whr_exome_M_ALL_Add
reading sources... [ 46%] datasets/schemas/giant_whr_exome_M_ALL_Rec
reading sources... [ 46%] datasets/schemas/giant_whr_exome_M_EUR_Add
reading sources... [ 47%] datasets/schemas/giant_whr_exome_M_EUR_Rec
reading sources... [ 47%] datasets/schemas/giant_whr_exome_W_ALL_Add
reading sources... [ 47%] datasets/schemas/giant_whr_exome_W_ALL_Rec
reading sources... [ 47%] datasets/schemas/giant_whr_exome_W_EUR_Add
reading sources... [ 48%] datasets/schemas/giant_whr_exome_W_EUR_Rec
reading sources... [ 48%] datasets/schemas/gnomad_annotation_pext
reading sources... [ 48%] datasets/schemas/gnomad_base_pext
reading sources... [ 49%] datasets/schemas/gnomad_chrM_coverage
reading sources... [ 49%] datasets/schemas/gnomad_chrM_sites
reading sources... [ 49%] datasets/schemas/gnomad_exome_coverage
reading sources... [ 50%] datasets/schemas/gnomad_exome_sites
reading sources... [ 50%] datasets/schemas/gnomad_genome_coverage
reading sources... [ 50%] datasets/schemas/gnomad_genome_sites
reading sources... [ 50%] datasets/schemas/gnomad_hgdp_1kg_subset_dense
reading sources... [ 51%] datasets/schemas/gnomad_hgdp_1kg_subset_sample_metadata
reading sources... [ 51%] datasets/schemas/gnomad_hgdp_1kg_subset_sparse
reading sources... [ 51%] datasets/schemas/gnomad_hgdp_1kg_subset_variant_annotations
reading sources... [ 52%] datasets/schemas/gnomad_ld_scores_afr
reading sources... [ 52%] datasets/schemas/gnomad_ld_scores_amr
reading sources... [ 52%] datasets/schemas/gnomad_ld_scores_asj
reading sources... [ 52%] datasets/schemas/gnomad_ld_scores_eas
reading sources... [ 53%] datasets/schemas/gnomad_ld_scores_est
reading sources... [ 53%] datasets/schemas/gnomad_ld_scores_fin
reading sources... [ 53%] datasets/schemas/gnomad_ld_scores_nfe
reading sources... [ 54%] datasets/schemas/gnomad_ld_scores_nwe
reading sources... [ 54%] datasets/schemas/gnomad_ld_scores_seu
reading sources... [ 54%] datasets/schemas/gnomad_ld_variant_indices_afr
reading sources... [ 54%] datasets/schemas/gnomad_ld_variant_indices_amr
reading sources... [ 55%] datasets/schemas/gnomad_ld_variant_indices_asj
reading sources... [ 55%] datasets/schemas/gnomad_ld_variant_indices_eas
reading sources... [ 55%] datasets/schemas/gnomad_ld_variant_indices_est
reading sources... [ 56%] datasets/schemas/gnomad_ld_variant_indices_fin
reading sources... [ 56%] datasets/schemas/gnomad_ld_variant_indices_nfe
reading sources... [ 56%] datasets/schemas/gnomad_ld_variant_indices_nwe
reading sources... [ 56%] datasets/schemas/gnomad_ld_variant_indices_seu
reading sources... [ 57%] datasets/schemas/gnomad_lof_metrics
reading sources... [ 57%] datasets/schemas/gnomad_mnv_genome_d01
reading sources... [ 57%] datasets/schemas/gnomad_mnv_genome_d02
reading sources... [ 58%] datasets/schemas/gnomad_mnv_genome_d03
reading sources... [ 58%] datasets/schemas/gnomad_mnv_genome_d04
reading sources... [ 58%] datasets/schemas/gnomad_mnv_genome_d05
reading sources... [ 58%] datasets/schemas/gnomad_mnv_genome_d06
reading sources... [ 59%] datasets/schemas/gnomad_mnv_genome_d07
reading sources... [ 59%] datasets/schemas/gnomad_mnv_genome_d08
reading sources... [ 59%] datasets/schemas/gnomad_mnv_genome_d09
reading sources... [ 60%] datasets/schemas/gnomad_mnv_genome_d10
reading sources... [ 60%] datasets/schemas/gnomad_pca_variant_loadings
reading sources... [ 60%] datasets/schemas/gnomad_plof_metrics_gene
reading sources... [ 60%] datasets/schemas/gnomad_plof_metrics_transcript
reading sources... [ 61%] datasets/schemas/gnomad_variant_co-occurrence
reading sources... [ 61%] datasets/schemas/ldsc_baselineLD_annotations
reading sources... [ 61%] datasets/schemas/ldsc_baselineLD_ldscores
reading sources... [ 62%] datasets/schemas/panukb_ld_scores_AFR
reading sources... [ 62%] datasets/schemas/panukb_ld_scores_AMR
reading sources... [ 62%] datasets/schemas/panukb_ld_scores_CSA
reading sources... [ 63%] datasets/schemas/panukb_ld_scores_EAS
reading sources... [ 63%] datasets/schemas/panukb_ld_scores_EUR
reading sources... [ 63%] datasets/schemas/panukb_ld_scores_MID
reading sources... [ 63%] datasets/schemas/panukb_ld_variant_indices_AFR
reading sources... [ 64%] datasets/schemas/panukb_ld_variant_indices_AMR
reading sources... [ 64%] datasets/schemas/panukb_ld_variant_indices_CSA
reading sources... [ 64%] datasets/schemas/panukb_ld_variant_indices_EAS
reading sources... [ 65%] datasets/schemas/panukb_ld_variant_indices_EUR
reading sources... [ 65%] datasets/schemas/panukb_ld_variant_indices_MID
reading sources... [ 65%] datasets/schemas/panukb_meta_analysis_all_ancestries
reading sources... [ 65%] datasets/schemas/panukb_meta_analysis_high_quality
reading sources... [ 66%] datasets/schemas/panukb_summary_stats
reading sources... [ 66%] experimental/hail.experimental.DB
reading sources... [ 66%] experimental/index
reading sources... [ 67%] experimental/ldscsim
reading sources... [ 67%] expressions
reading sources... [ 67%] fs_api
reading sources... [ 67%] functions/collections
reading sources... [ 68%] functions/constructors
reading sources... [ 68%] functions/core
reading sources... [ 68%] functions/genetics
reading sources... [ 69%] functions/hail.expr.builders.CaseBuilder
reading sources... [ 69%] functions/hail.expr.builders.SwitchBuilder
reading sources... [ 69%] functions/index
reading sources... [ 69%] functions/numeric
reading sources... [ 70%] functions/random
reading sources... [ 70%] functions/stats
reading sources... [ 70%] functions/string
reading sources... [ 71%] genetics/hail.genetics.Call
reading sources... [ 71%] genetics/hail.genetics.Locus
reading sources... [ 71%] genetics/hail.genetics.Pedigree
reading sources... [ 71%] genetics/hail.genetics.ReferenceGenome
reading sources... [ 72%] genetics/hail.genetics.Trio
reading sources... [ 72%] genetics/index
reading sources... [ 72%] getting_started
reading sources... [ 73%] getting_started_developing
reading sources... [ 73%] ggplot/index
reading sources... [ 73%] guides
reading sources... [ 73%] guides/agg
reading sources... [ 74%] guides/annotation
reading sources... [ 74%] guides/genetics
reading sources... [ 74%] hadoop_glob_patterns
reading sources... [ 75%] hail.GroupedMatrixTable
reading sources... [ 75%] hail.GroupedTable
reading sources... [ 75%] hail.MatrixTable
reading sources... [ 76%] hail.Table
reading sources... [ 76%] hail.expr.ArrayExpression
reading sources... [ 76%] hail.expr.ArrayNumericExpression
reading sources... [ 76%] hail.expr.BooleanExpression
reading sources... [ 77%] hail.expr.CallExpression
reading sources... [ 77%] hail.expr.CollectionExpression
reading sources... [ 77%] hail.expr.DictExpression
reading sources... [ 78%] hail.expr.Expression
reading sources... [ 78%] hail.expr.Float32Expression
reading sources... [ 78%] hail.expr.Float64Expression
reading sources... [ 78%] hail.expr.Int32Expression
reading sources... [ 79%] hail.expr.Int64Expression
reading sources... [ 79%] hail.expr.IntervalExpression
reading sources... [ 79%] hail.expr.LocusExpression
reading sources... [ 80%] hail.expr.NDArrayExpression
reading sources... [ 80%] hail.expr.NDArrayNumericExpression
reading sources... [ 80%] hail.expr.NumericExpression
reading sources... [ 80%] hail.expr.SetExpression
reading sources... [ 81%] hail.expr.StringExpression
reading sources... [ 81%] hail.expr.StructExpression
reading sources... [ 81%] hail.expr.TupleExpression
reading sources... [ 82%] hail_on_the_cloud
reading sources... [ 82%] index
reading sources... [ 82%] install/azure
reading sources... [ 82%] install/dataproc
reading sources... [ 83%] install/linux
reading sources... [ 83%] install/macosx
reading sources... [ 83%] install/other-cluster
reading sources... [ 84%] install/try
reading sources... [ 84%] libraries
reading sources... [ 84%] linalg/hail.linalg.BlockMatrix
reading sources... [ 84%] linalg/index
reading sources... [ 85%] linalg/utils/index
reading sources... [ 85%] methods/genetics
reading sources... [ 85%] methods/impex
reading sources... [ 86%] methods/index
reading sources... [ 86%] methods/misc
reading sources... [ 86%] methods/relatedness
reading sources... [ 86%] methods/stats
reading sources... [ 87%] nd/index
reading sources... [ 87%] other_resources
reading sources... [ 87%] overview/expressions
reading sources... [ 88%] overview/index
reading sources... [ 88%] overview/matrix_table
reading sources... [ 88%] overview/table
reading sources... [ 89%] plot
reading sources... [ 89%] root_api
reading sources... [ 89%] scans
reading sources... [ 89%] stats/hail.stats.LinearMixedModel
reading sources... [ 90%] stats/index
reading sources... [ 90%] tutorials-landing
reading sources... [ 90%] tutorials/01-genome-wide-association-study
24/02/01 22:20:59 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).

[Stage 0:>                                                         (0 + 1) / 16]

[Stage 0:===>                                                      (1 + 1) / 16]

[Stage 0:=======>                                                  (2 + 1) / 16]

[Stage 0:==========>                                               (3 + 1) / 16]

[Stage 0:==================>                                       (5 + 1) / 16]

[Stage 0:=========================>                                (7 + 1) / 16]

[Stage 0:=============================>                            (8 + 1) / 16]

[Stage 0:===================================>                     (10 + 1) / 16]

[Stage 0:==========================================>              (12 + 1) / 16]

[Stage 0:=================================================>       (14 + 1) / 16]

[Stage 1:>                                                         (0 + 1) / 16]

[Stage 1:===>                                                      (1 + 1) / 16]

[Stage 1:=======>                                                  (2 + 1) / 16]

[Stage 1:==========>                                               (3 + 1) / 16]

[Stage 1:==============>                                           (4 + 1) / 16]

[Stage 1:==================>                                       (5 + 1) / 16]

[Stage 1:=====================>                                    (6 + 1) / 16]

[Stage 1:=========================>                                (7 + 1) / 16]

[Stage 1:=============================>                            (8 + 1) / 16]

[Stage 1:================================>                         (9 + 1) / 16]

[Stage 1:===================================>                     (10 + 1) / 16]

[Stage 1:=======================================>                 (11 + 1) / 16]

[Stage 1:==========================================>              (12 + 1) / 16]

[Stage 1:==============================================>          (13 + 1) / 16]

[Stage 1:=================================================>       (14 + 1) / 16]

[Stage 1:=====================================================>   (15 + 1) / 16]

[Stage 2:>                                                          (0 + 1) / 1]

[Stage 3:>                                                          (0 + 1) / 1]

[Stage 22:>                                                         (0 + 1) / 1]

[Stage 24:>                                                         (0 + 1) / 1]

[Stage 27:>                                                         (0 + 1) / 1]

[Stage 30:>                                                         (0 + 1) / 1]

[Stage 34:>                                                         (0 + 1) / 1]

[Stage 36:>                                                         (0 + 1) / 1]

[Stage 37:>                                                         (0 + 1) / 1]

[Stage 41:>                                                         (0 + 1) / 1]

[Stage 55:>                                                         (0 + 1) / 1]

[Stage 56:>                                                         (0 + 1) / 1]

[Stage 57:>                                                         (0 + 1) / 1]

[Stage 58:>                                                         (0 + 1) / 1]

[Stage 59:>                                                         (0 + 1) / 1]

[Stage 158:>                                                        (0 + 1) / 1]

[Stage 161:>                                                        (0 + 1) / 1]

[Stage 164:>                                                        (0 + 1) / 1]

[Stage 166:>                                                        (0 + 1) / 1]

[Stage 183:>                                                        (0 + 1) / 1]

[Stage 184:>                                                        (0 + 1) / 1]

[Stage 191:>                                                        (0 + 1) / 1]

[Stage 192:>                                                        (0 + 1) / 1]

[Stage 193:>                                                        (0 + 1) / 1]

[Stage 198:>                                                        (0 + 1) / 1]

[Stage 200:>                                                        (0 + 1) / 1]

[Stage 201:>                                                        (0 + 1) / 1]

[Stage 306:>                                                        (0 + 1) / 1]

[Stage 308:>                                                        (0 + 1) / 1]

[Stage 310:>                                                        (0 + 1) / 1]
/usr/local/lib/python3.9/dist-packages/nbsphinx/__init__.py:1058: RuntimeWarning: You are using an unsupported version of pandoc (2.9.2.1).
Your version must be at least (2.14.2) but less than (4.0.0).
Refer to https://pandoc.org/installing.html.
Continuing with doubts...
  nbconvert.utils.pandoc.check_pandoc_version()
reading sources... [ 91%] tutorials/03-tables
24/02/01 22:23:55 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
reading sources... [ 91%] tutorials/04-aggregation
24/02/01 22:24:29 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
reading sources... [ 91%] tutorials/05-filter-annotate
24/02/01 22:24:58 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).

[Stage 0:>                                                          (0 + 1) / 1]
reading sources... [ 91%] tutorials/06-joins
24/02/01 22:25:33 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).

[Stage 18:>                                                         (0 + 1) / 1]

[Stage 19:>                                                         (0 + 1) / 1]

[Stage 20:>                                                         (0 + 1) / 1]

[Stage 39:>                                                         (0 + 1) / 1]

[Stage 48:>                                                         (0 + 1) / 1]

[Stage 49:>                                                         (0 + 1) / 1]

[Stage 52:>                                                         (0 + 1) / 1]

[Stage 62:>                                                         (0 + 1) / 1]

[Stage 63:>                                                         (0 + 1) / 1]

[Stage 66:>                                                         (0 + 1) / 1]

[Stage 67:>                                                         (0 + 1) / 1]

[Stage 80:>                                                         (0 + 1) / 1]

[Stage 81:>                                                         (0 + 1) / 1]

[Stage 86:>                                                         (0 + 1) / 1]

[Stage 87:>                                                         (0 + 1) / 1]

[Stage 90:>                                                         (0 + 1) / 1]

[Stage 91:>                                                         (0 + 1) / 1]

[Stage 101:>                                                        (0 + 1) / 1]

[Stage 102:>                                                        (0 + 1) / 1]

[Stage 109:>                                                        (0 + 1) / 1]

[Stage 116:>                                                        (0 + 1) / 1]
reading sources... [ 92%] tutorials/07-matrixtable
24/02/01 22:26:51 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).

[Stage 0:>                                                          (0 + 1) / 1]

[Stage 9:>                                                          (0 + 1) / 1]

[Stage 10:>                                                         (0 + 1) / 1]
reading sources... [ 92%] tutorials/08-plotting
24/02/01 22:27:30 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).

[Stage 3:>                                                          (0 + 1) / 1]

[Stage 4:>                                                          (0 + 1) / 1]

[Stage 5:>                                                          (0 + 1) / 1]

[Stage 7:>                                                          (0 + 1) / 1]

[Stage 10:>                                                         (0 + 1) / 1]

[Stage 12:>                                                         (0 + 1) / 1]

[Stage 13:>                                                         (0 + 1) / 1]

[Stage 14:>                                                         (0 + 1) / 1]
reading sources... [ 92%] tutorials/09-ggplot
24/02/01 22:28:53 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
reading sources... [ 93%] types
reading sources... [ 93%] utils/index
reading sources... [ 93%] vds/hail.vds.VariantDataset
reading sources... [ 93%] vds/hail.vds.combiner.VDSMetadata
reading sources... [ 94%] vds/hail.vds.combiner.VariantDatasetCombiner
reading sources... [ 94%] vds/hail.vds.combiner.load_combiner
reading sources... [ 94%] vds/hail.vds.combiner.new_combiner
reading sources... [ 95%] vds/hail.vds.filter_chromosomes
reading sources... [ 95%] vds/hail.vds.filter_intervals
reading sources... [ 95%] vds/hail.vds.filter_samples
reading sources... [ 95%] vds/hail.vds.filter_variants
reading sources... [ 96%] vds/hail.vds.impute_sex_chr_ploidy_from_interval_coverage
reading sources... [ 96%] vds/hail.vds.impute_sex_chromosome_ploidy
reading sources... [ 96%] vds/hail.vds.interval_coverage
reading sources... [ 97%] vds/hail.vds.lgt_to_gt
reading sources... [ 97%] vds/hail.vds.local_to_global
reading sources... [ 97%] vds/hail.vds.merge_reference_blocks
reading sources... [ 97%] vds/hail.vds.read_vds
reading sources... [ 98%] vds/hail.vds.sample_qc
reading sources... [ 98%] vds/hail.vds.split_multi
reading sources... [ 98%] vds/hail.vds.store_ref_block_max_length
reading sources... [ 99%] vds/hail.vds.to_dense_mt
reading sources... [ 99%] vds/hail.vds.to_merged_sparse_mt
reading sources... [ 99%] vds/hail.vds.truncate_reference_blocks
reading sources... [100%] vds/index

/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:861: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:894: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:925: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:958: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:993: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:1028: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:1059: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:1092: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:1127: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:1162: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:1193: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:1222: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:1251: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:1284: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:1315: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:1348: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:1378: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:1431: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:1459: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:2786: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:3198: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:3298: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:3409: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:3575: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:3933: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:3962: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:4041: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:4344: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:4373: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:4402: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:4431: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:4460: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:4488: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:4735: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:4848: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:4876: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:5118: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:5147: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:5310: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:5339: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:5368: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:5533: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:5562: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:5591: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:5620: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:5649: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/01-genome-wide-association-study.ipynb:5677: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/05-filter-annotate.ipynb:548: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/06-joins.ipynb:1385: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/06-joins.ipynb:1414: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/06-joins.ipynb:1443: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/06-joins.ipynb:1860: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/06-joins.ipynb:2061: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/06-joins.ipynb:2090: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/06-joins.ipynb:2119: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/06-joins.ipynb:2285: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/06-joins.ipynb:2314: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/06-joins.ipynb:2343: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/06-joins.ipynb:2372: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/06-joins.ipynb:2529: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/06-joins.ipynb:2558: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/06-joins.ipynb:2587: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/06-joins.ipynb:2616: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/06-joins.ipynb:2645: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/06-joins.ipynb:2674: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/06-joins.ipynb:2703: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/06-joins.ipynb:2732: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/06-joins.ipynb:2761: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/06-joins.ipynb:2790: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/07-matrixtable.ipynb:1344: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/07-matrixtable.ipynb:2118: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/07-matrixtable.ipynb:2231: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/08-plotting.ipynb:791: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/08-plotting.ipynb:902: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/08-plotting.ipynb:1016: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/08-plotting.ipynb:1130: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/08-plotting.ipynb:1249: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/08-plotting.ipynb:1278: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/08-plotting.ipynb:1307: ERROR: Content block expected for the "raw" directive; none found.
/io/hail/python/hail/docs/tutorials/08-plotting.ipynb:1335: ERROR: Content block expected for the "raw" directive; none found.
looking for now-outdated files... none found
pickling environment... done
checking consistency... done
preparing documents... done
writing output... [  0%] aggregators
writing output... [  0%] annotation_database_ui
writing output... [  0%] api
writing output... [  1%] batch_api
writing output... [  1%] change_log
writing output... [  1%] cheatsheets
writing output... [  2%] cloud/amazon_web_services
writing output... [  2%] cloud/azure
writing output... [  2%] cloud/databricks
writing output... [  2%] cloud/general_advice
writing output... [  3%] cloud/google_cloud
writing output... [  3%] cloud/query_on_batch
writing output... [  3%] configuration_reference
writing output... [  4%] datasets
writing output... [  4%] datasets/schemas
writing output... [  4%] datasets/schemas/1000_Genomes_HighCov_autosomes
writing output... [  4%] datasets/schemas/1000_Genomes_HighCov_chrX
writing output... [  5%] datasets/schemas/1000_Genomes_HighCov_chrY
writing output... [  5%] datasets/schemas/1000_Genomes_Retracted_autosomes
writing output... [  5%] datasets/schemas/1000_Genomes_Retracted_chrX
writing output... [  6%] datasets/schemas/1000_Genomes_Retracted_chrY
writing output... [  6%] datasets/schemas/1000_Genomes_autosomes
writing output... [  6%] datasets/schemas/1000_Genomes_chrMT
writing output... [  6%] datasets/schemas/1000_Genomes_chrX
writing output... [  7%] datasets/schemas/1000_Genomes_chrY
writing output... [  7%] datasets/schemas/CADD
writing output... [  7%] datasets/schemas/DANN
writing output... [  8%] datasets/schemas/Ensembl_homo_sapiens_low_complexity_regions
writing output... [  8%] datasets/schemas/Ensembl_homo_sapiens_reference_genome
writing output... [  8%] datasets/schemas/GTEx_RNA_seq_gene_TPMs
writing output... [  8%] datasets/schemas/GTEx_RNA_seq_gene_read_counts
writing output... [  9%] datasets/schemas/GTEx_RNA_seq_junction_read_counts
writing output... [  9%] datasets/schemas/GTEx_eQTL_Adipose_Subcutaneous_all_snp_gene_associations
writing output... [  9%] datasets/schemas/GTEx_eQTL_Adipose_Visceral_Omentum_all_snp_gene_associations
writing output... [ 10%] datasets/schemas/GTEx_eQTL_Adrenal_Gland_all_snp_gene_associations
writing output... [ 10%] datasets/schemas/GTEx_eQTL_Artery_Aorta_all_snp_gene_associations
writing output... [ 10%] datasets/schemas/GTEx_eQTL_Artery_Coronary_all_snp_gene_associations
writing output... [ 10%] datasets/schemas/GTEx_eQTL_Artery_Tibial_all_snp_gene_associations
writing output... [ 11%] datasets/schemas/GTEx_eQTL_Brain_Amygdala_all_snp_gene_associations
writing output... [ 11%] datasets/schemas/GTEx_eQTL_Brain_Anterior_cingulate_cortex_BA24_all_snp_gene_associations
writing output... [ 11%] datasets/schemas/GTEx_eQTL_Brain_Caudate_basal_ganglia_all_snp_gene_associations
writing output... [ 12%] datasets/schemas/GTEx_eQTL_Brain_Cerebellar_Hemisphere_all_snp_gene_associations
writing output... [ 12%] datasets/schemas/GTEx_eQTL_Brain_Cerebellum_all_snp_gene_associations
writing output... [ 12%] datasets/schemas/GTEx_eQTL_Brain_Cortex_all_snp_gene_associations
writing output... [ 13%] datasets/schemas/GTEx_eQTL_Brain_Frontal_Cortex_BA9_all_snp_gene_associations
writing output... [ 13%] datasets/schemas/GTEx_eQTL_Brain_Hippocampus_all_snp_gene_associations
writing output... [ 13%] datasets/schemas/GTEx_eQTL_Brain_Hypothalamus_all_snp_gene_associations
writing output... [ 13%] datasets/schemas/GTEx_eQTL_Brain_Nucleus_accumbens_basal_ganglia_all_snp_gene_associations
writing output... [ 14%] datasets/schemas/GTEx_eQTL_Brain_Putamen_basal_ganglia_all_snp_gene_associations
writing output... [ 14%] datasets/schemas/GTEx_eQTL_Brain_Spinal_cord_cervical_c-1_all_snp_gene_associations
writing output... [ 14%] datasets/schemas/GTEx_eQTL_Brain_Substantia_nigra_all_snp_gene_associations
writing output... [ 15%] datasets/schemas/GTEx_eQTL_Breast_Mammary_Tissue_all_snp_gene_associations
writing output... [ 15%] datasets/schemas/GTEx_eQTL_Cells_Cultured_fibroblasts_all_snp_gene_associations
writing output... [ 15%] datasets/schemas/GTEx_eQTL_Cells_EBV-transformed_lymphocytes_all_snp_gene_associations
writing output... [ 15%] datasets/schemas/GTEx_eQTL_Colon_Sigmoid_all_snp_gene_associations
writing output... [ 16%] datasets/schemas/GTEx_eQTL_Colon_Transverse_all_snp_gene_associations
writing output... [ 16%] datasets/schemas/GTEx_eQTL_Esophagus_Gastroesophageal_Junction_all_snp_gene_associations
writing output... [ 16%] datasets/schemas/GTEx_eQTL_Esophagus_Mucosa_all_snp_gene_associations
writing output... [ 17%] datasets/schemas/GTEx_eQTL_Esophagus_Muscularis_all_snp_gene_associations
writing output... [ 17%] datasets/schemas/GTEx_eQTL_Heart_Atrial_Appendage_all_snp_gene_associations
writing output... [ 17%] datasets/schemas/GTEx_eQTL_Heart_Left_Ventricle_all_snp_gene_associations
writing output... [ 17%] datasets/schemas/GTEx_eQTL_Kidney_Cortex_all_snp_gene_associations
writing output... [ 18%] datasets/schemas/GTEx_eQTL_Liver_all_snp_gene_associations
writing output... [ 18%] datasets/schemas/GTEx_eQTL_Lung_all_snp_gene_associations
writing output... [ 18%] datasets/schemas/GTEx_eQTL_Minor_Salivary_Gland_all_snp_gene_associations
writing output... [ 19%] datasets/schemas/GTEx_eQTL_Muscle_Skeletal_all_snp_gene_associations
writing output... [ 19%] datasets/schemas/GTEx_eQTL_Nerve_Tibial_all_snp_gene_associations
writing output... [ 19%] datasets/schemas/GTEx_eQTL_Ovary_all_snp_gene_associations
writing output... [ 19%] datasets/schemas/GTEx_eQTL_Pancreas_all_snp_gene_associations
writing output... [ 20%] datasets/schemas/GTEx_eQTL_Pituitary_all_snp_gene_associations
writing output... [ 20%] datasets/schemas/GTEx_eQTL_Prostate_all_snp_gene_associations
writing output... [ 20%] datasets/schemas/GTEx_eQTL_Skin_Not_Sun_Exposed_Suprapubic_all_snp_gene_associations
writing output... [ 21%] datasets/schemas/GTEx_eQTL_Skin_Sun_Exposed_Lower_leg_all_snp_gene_associations
writing output... [ 21%] datasets/schemas/GTEx_eQTL_Small_Intestine_Terminal_Ileum_all_snp_gene_associations
writing output... [ 21%] datasets/schemas/GTEx_eQTL_Spleen_all_snp_gene_associations
writing output... [ 21%] datasets/schemas/GTEx_eQTL_Stomach_all_snp_gene_associations
writing output... [ 22%] datasets/schemas/GTEx_eQTL_Testis_all_snp_gene_associations
writing output... [ 22%] datasets/schemas/GTEx_eQTL_Thyroid_all_snp_gene_associations
writing output... [ 22%] datasets/schemas/GTEx_eQTL_Uterus_all_snp_gene_associations
writing output... [ 23%] datasets/schemas/GTEx_eQTL_Vagina_all_snp_gene_associations
writing output... [ 23%] datasets/schemas/GTEx_eQTL_Whole_Blood_all_snp_gene_associations
writing output... [ 23%] datasets/schemas/GTEx_eQTL_all_snp_gene_associations
writing output... [ 23%] datasets/schemas/GTEx_sQTL_Adipose_Subcutaneous_all_snp_gene_associations
writing output... [ 24%] datasets/schemas/GTEx_sQTL_Adipose_Visceral_Omentum_all_snp_gene_associations
writing output... [ 24%] datasets/schemas/GTEx_sQTL_Adrenal_Gland_all_snp_gene_associations
writing output... [ 24%] datasets/schemas/GTEx_sQTL_Artery_Aorta_all_snp_gene_associations
writing output... [ 25%] datasets/schemas/GTEx_sQTL_Artery_Coronary_all_snp_gene_associations
writing output... [ 25%] datasets/schemas/GTEx_sQTL_Artery_Tibial_all_snp_gene_associations
writing output... [ 25%] datasets/schemas/GTEx_sQTL_Brain_Amygdala_all_snp_gene_associations
writing output... [ 26%] datasets/schemas/GTEx_sQTL_Brain_Anterior_cingulate_cortex_BA24_all_snp_gene_associations
writing output... [ 26%] datasets/schemas/GTEx_sQTL_Brain_Caudate_basal_ganglia_all_snp_gene_associations
writing output... [ 26%] datasets/schemas/GTEx_sQTL_Brain_Cerebellar_Hemisphere_all_snp_gene_associations
writing output... [ 26%] datasets/schemas/GTEx_sQTL_Brain_Cerebellum_all_snp_gene_associations
writing output... [ 27%] datasets/schemas/GTEx_sQTL_Brain_Cortex_all_snp_gene_associations
writing output... [ 27%] datasets/schemas/GTEx_sQTL_Brain_Frontal_Cortex_BA9_all_snp_gene_associations
writing output... [ 27%] datasets/schemas/GTEx_sQTL_Brain_Hippocampus_all_snp_gene_associations
writing output... [ 28%] datasets/schemas/GTEx_sQTL_Brain_Hypothalamus_all_snp_gene_associations
writing output... [ 28%] datasets/schemas/GTEx_sQTL_Brain_Nucleus_accumbens_basal_ganglia_all_snp_gene_associations
writing output... [ 28%] datasets/schemas/GTEx_sQTL_Brain_Putamen_basal_ganglia_all_snp_gene_associations
writing output... [ 28%] datasets/schemas/GTEx_sQTL_Brain_Spinal_cord_cervical_c-1_all_snp_gene_associations
writing output... [ 29%] datasets/schemas/GTEx_sQTL_Brain_Substantia_nigra_all_snp_gene_associations
writing output... [ 29%] datasets/schemas/GTEx_sQTL_Breast_Mammary_Tissue_all_snp_gene_associations
writing output... [ 29%] datasets/schemas/GTEx_sQTL_Cells_Cultured_fibroblasts_all_snp_gene_associations
writing output... [ 30%] datasets/schemas/GTEx_sQTL_Cells_EBV-transformed_lymphocytes_all_snp_gene_associations
writing output... [ 30%] datasets/schemas/GTEx_sQTL_Colon_Sigmoid_all_snp_gene_associations
writing output... [ 30%] datasets/schemas/GTEx_sQTL_Colon_Transverse_all_snp_gene_associations
writing output... [ 30%] datasets/schemas/GTEx_sQTL_Esophagus_Gastroesophageal_Junction_all_snp_gene_associations
writing output... [ 31%] datasets/schemas/GTEx_sQTL_Esophagus_Mucosa_all_snp_gene_associations
writing output... [ 31%] datasets/schemas/GTEx_sQTL_Esophagus_Muscularis_all_snp_gene_associations
writing output... [ 31%] datasets/schemas/GTEx_sQTL_Heart_Atrial_Appendage_all_snp_gene_associations
writing output... [ 32%] datasets/schemas/GTEx_sQTL_Heart_Left_Ventricle_all_snp_gene_associations
writing output... [ 32%] datasets/schemas/GTEx_sQTL_Kidney_Cortex_all_snp_gene_associations
writing output... [ 32%] datasets/schemas/GTEx_sQTL_Liver_all_snp_gene_associations
writing output... [ 32%] datasets/schemas/GTEx_sQTL_Lung_all_snp_gene_associations
writing output... [ 33%] datasets/schemas/GTEx_sQTL_Minor_Salivary_Gland_all_snp_gene_associations
writing output... [ 33%] datasets/schemas/GTEx_sQTL_Muscle_Skeletal_all_snp_gene_associations
writing output... [ 33%] datasets/schemas/GTEx_sQTL_Nerve_Tibial_all_snp_gene_associations
writing output... [ 34%] datasets/schemas/GTEx_sQTL_Ovary_all_snp_gene_associations
writing output... [ 34%] datasets/schemas/GTEx_sQTL_Pancreas_all_snp_gene_associations
writing output... [ 34%] datasets/schemas/GTEx_sQTL_Pituitary_all_snp_gene_associations
writing output... [ 34%] datasets/schemas/GTEx_sQTL_Prostate_all_snp_gene_associations
writing output... [ 35%] datasets/schemas/GTEx_sQTL_Skin_Not_Sun_Exposed_Suprapubic_all_snp_gene_associations
writing output... [ 35%] datasets/schemas/GTEx_sQTL_Skin_Sun_Exposed_Lower_leg_all_snp_gene_associations
writing output... [ 35%] datasets/schemas/GTEx_sQTL_Small_Intestine_Terminal_Ileum_all_snp_gene_associations
writing output... [ 36%] datasets/schemas/GTEx_sQTL_Spleen_all_snp_gene_associations
writing output... [ 36%] datasets/schemas/GTEx_sQTL_Stomach_all_snp_gene_associations
writing output... [ 36%] datasets/schemas/GTEx_sQTL_Testis_all_snp_gene_associations
writing output... [ 36%] datasets/schemas/GTEx_sQTL_Thyroid_all_snp_gene_associations
writing output... [ 37%] datasets/schemas/GTEx_sQTL_Uterus_all_snp_gene_associations
writing output... [ 37%] datasets/schemas/GTEx_sQTL_Vagina_all_snp_gene_associations
writing output... [ 37%] datasets/schemas/GTEx_sQTL_Whole_Blood_all_snp_gene_associations
writing output... [ 38%] datasets/schemas/UK_Biobank_Rapid_GWAS_both_sexes
writing output... [ 38%] datasets/schemas/UK_Biobank_Rapid_GWAS_female
writing output... [ 38%] datasets/schemas/UK_Biobank_Rapid_GWAS_male
writing output... [ 39%] datasets/schemas/clinvar_gene_summary
writing output... [ 39%] datasets/schemas/clinvar_variant_summary
writing output... [ 39%] datasets/schemas/dbNSFP_genes
writing output... [ 39%] datasets/schemas/dbNSFP_variants
writing output... [ 40%] datasets/schemas/dbSNP
writing output... [ 40%] datasets/schemas/dbSNP_rsid
writing output... [ 40%] datasets/schemas/gencode
writing output... [ 41%] datasets/schemas/gerp_elements
writing output... [ 41%] datasets/schemas/gerp_scores
writing output... [ 41%] datasets/schemas/giant_bmi_exome_AFR
writing output... [ 41%] datasets/schemas/giant_bmi_exome_ALL
writing output... [ 42%] datasets/schemas/giant_bmi_exome_AMR
writing output... [ 42%] datasets/schemas/giant_bmi_exome_EAS
writing output... [ 42%] datasets/schemas/giant_bmi_exome_EUR
writing output... [ 43%] datasets/schemas/giant_bmi_exome_SAS
writing output... [ 43%] datasets/schemas/giant_height_exome_AFR
writing output... [ 43%] datasets/schemas/giant_height_exome_ALL
writing output... [ 43%] datasets/schemas/giant_height_exome_AMR
writing output... [ 44%] datasets/schemas/giant_height_exome_EAS
writing output... [ 44%] datasets/schemas/giant_height_exome_EUR
writing output... [ 44%] datasets/schemas/giant_height_exome_SAS
writing output... [ 45%] datasets/schemas/giant_whr_exome_C_ALL_Add
writing output... [ 45%] datasets/schemas/giant_whr_exome_C_ALL_Rec
writing output... [ 45%] datasets/schemas/giant_whr_exome_C_EUR_Add
writing output... [ 45%] datasets/schemas/giant_whr_exome_C_EUR_Rec
writing output... [ 46%] datasets/schemas/giant_whr_exome_M_ALL_Add
writing output... [ 46%] datasets/schemas/giant_whr_exome_M_ALL_Rec
writing output... [ 46%] datasets/schemas/giant_whr_exome_M_EUR_Add
writing output... [ 47%] datasets/schemas/giant_whr_exome_M_EUR_Rec
writing output... [ 47%] datasets/schemas/giant_whr_exome_W_ALL_Add
writing output... [ 47%] datasets/schemas/giant_whr_exome_W_ALL_Rec
writing output... [ 47%] datasets/schemas/giant_whr_exome_W_EUR_Add
writing output... [ 48%] datasets/schemas/giant_whr_exome_W_EUR_Rec
writing output... [ 48%] datasets/schemas/gnomad_annotation_pext
writing output... [ 48%] datasets/schemas/gnomad_base_pext
writing output... [ 49%] datasets/schemas/gnomad_chrM_coverage
writing output... [ 49%] datasets/schemas/gnomad_chrM_sites
writing output... [ 49%] datasets/schemas/gnomad_exome_coverage
writing output... [ 50%] datasets/schemas/gnomad_exome_sites
writing output... [ 50%] datasets/schemas/gnomad_genome_coverage
writing output... [ 50%] datasets/schemas/gnomad_genome_sites
writing output... [ 50%] datasets/schemas/gnomad_hgdp_1kg_subset_dense
writing output... [ 51%] datasets/schemas/gnomad_hgdp_1kg_subset_sample_metadata
writing output... [ 51%] datasets/schemas/gnomad_hgdp_1kg_subset_sparse
writing output... [ 51%] datasets/schemas/gnomad_hgdp_1kg_subset_variant_annotations
writing output... [ 52%] datasets/schemas/gnomad_ld_scores_afr
writing output... [ 52%] datasets/schemas/gnomad_ld_scores_amr
writing output... [ 52%] datasets/schemas/gnomad_ld_scores_asj
writing output... [ 52%] datasets/schemas/gnomad_ld_scores_eas
writing output... [ 53%] datasets/schemas/gnomad_ld_scores_est
writing output... [ 53%] datasets/schemas/gnomad_ld_scores_fin
writing output... [ 53%] datasets/schemas/gnomad_ld_scores_nfe
writing output... [ 54%] datasets/schemas/gnomad_ld_scores_nwe
writing output... [ 54%] datasets/schemas/gnomad_ld_scores_seu
writing output... [ 54%] datasets/schemas/gnomad_ld_variant_indices_afr
writing output... [ 54%] datasets/schemas/gnomad_ld_variant_indices_amr
writing output... [ 55%] datasets/schemas/gnomad_ld_variant_indices_asj
writing output... [ 55%] datasets/schemas/gnomad_ld_variant_indices_eas
writing output... [ 55%] datasets/schemas/gnomad_ld_variant_indices_est
writing output... [ 56%] datasets/schemas/gnomad_ld_variant_indices_fin
writing output... [ 56%] datasets/schemas/gnomad_ld_variant_indices_nfe
writing output... [ 56%] datasets/schemas/gnomad_ld_variant_indices_nwe
writing output... [ 56%] datasets/schemas/gnomad_ld_variant_indices_seu
writing output... [ 57%] datasets/schemas/gnomad_lof_metrics
writing output... [ 57%] datasets/schemas/gnomad_mnv_genome_d01
writing output... [ 57%] datasets/schemas/gnomad_mnv_genome_d02
writing output... [ 58%] datasets/schemas/gnomad_mnv_genome_d03
writing output... [ 58%] datasets/schemas/gnomad_mnv_genome_d04
writing output... [ 58%] datasets/schemas/gnomad_mnv_genome_d05
writing output... [ 58%] datasets/schemas/gnomad_mnv_genome_d06
writing output... [ 59%] datasets/schemas/gnomad_mnv_genome_d07
writing output... [ 59%] datasets/schemas/gnomad_mnv_genome_d08
writing output... [ 59%] datasets/schemas/gnomad_mnv_genome_d09
writing output... [ 60%] datasets/schemas/gnomad_mnv_genome_d10
writing output... [ 60%] datasets/schemas/gnomad_pca_variant_loadings
writing output... [ 60%] datasets/schemas/gnomad_plof_metrics_gene
writing output... [ 60%] datasets/schemas/gnomad_plof_metrics_transcript
writing output... [ 61%] datasets/schemas/gnomad_variant_co-occurrence
writing output... [ 61%] datasets/schemas/ldsc_baselineLD_annotations
writing output... [ 61%] datasets/schemas/ldsc_baselineLD_ldscores
writing output... [ 62%] datasets/schemas/panukb_ld_scores_AFR
writing output... [ 62%] datasets/schemas/panukb_ld_scores_AMR
writing output... [ 62%] datasets/schemas/panukb_ld_scores_CSA
writing output... [ 63%] datasets/schemas/panukb_ld_scores_EAS
writing output... [ 63%] datasets/schemas/panukb_ld_scores_EUR
writing output... [ 63%] datasets/schemas/panukb_ld_scores_MID
writing output... [ 63%] datasets/schemas/panukb_ld_variant_indices_AFR
writing output... [ 64%] datasets/schemas/panukb_ld_variant_indices_AMR
writing output... [ 64%] datasets/schemas/panukb_ld_variant_indices_CSA
writing output... [ 64%] datasets/schemas/panukb_ld_variant_indices_EAS
writing output... [ 65%] datasets/schemas/panukb_ld_variant_indices_EUR
writing output... [ 65%] datasets/schemas/panukb_ld_variant_indices_MID
writing output... [ 65%] datasets/schemas/panukb_meta_analysis_all_ancestries
writing output... [ 65%] datasets/schemas/panukb_meta_analysis_high_quality
writing output... [ 66%] datasets/schemas/panukb_summary_stats
writing output... [ 66%] experimental/hail.experimental.DB
writing output... [ 66%] experimental/index
writing output... [ 67%] experimental/ldscsim
writing output... [ 67%] expressions
writing output... [ 67%] fs_api
writing output... [ 67%] functions/collections
writing output... [ 68%] functions/constructors
writing output... [ 68%] functions/core
writing output... [ 68%] functions/genetics
writing output... [ 69%] functions/hail.expr.builders.CaseBuilder
writing output... [ 69%] functions/hail.expr.builders.SwitchBuilder
writing output... [ 69%] functions/index
writing output... [ 69%] functions/numeric
writing output... [ 70%] functions/random
writing output... [ 70%] functions/stats
writing output... [ 70%] functions/string
writing output... [ 71%] genetics/hail.genetics.Call
writing output... [ 71%] genetics/hail.genetics.Locus
writing output... [ 71%] genetics/hail.genetics.Pedigree
writing output... [ 71%] genetics/hail.genetics.ReferenceGenome
writing output... [ 72%] genetics/hail.genetics.Trio
writing output... [ 72%] genetics/index
writing output... [ 72%] getting_started
writing output... [ 73%] getting_started_developing
writing output... [ 73%] ggplot/index
writing output... [ 73%] guides
writing output... [ 73%] guides/agg
writing output... [ 74%] guides/annotation
writing output... [ 74%] guides/genetics
writing output... [ 74%] hadoop_glob_patterns
writing output... [ 75%] hail.GroupedMatrixTable
writing output... [ 75%] hail.GroupedTable
writing output... [ 75%] hail.MatrixTable
writing output... [ 76%] hail.Table
writing output... [ 76%] hail.expr.ArrayExpression
writing output... [ 76%] hail.expr.ArrayNumericExpression
writing output... [ 76%] hail.expr.BooleanExpression
writing output... [ 77%] hail.expr.CallExpression
writing output... [ 77%] hail.expr.CollectionExpression
writing output... [ 77%] hail.expr.DictExpression
writing output... [ 78%] hail.expr.Expression
writing output... [ 78%] hail.expr.Float32Expression
writing output... [ 78%] hail.expr.Float64Expression
writing output... [ 78%] hail.expr.Int32Expression
writing output... [ 79%] hail.expr.Int64Expression
writing output... [ 79%] hail.expr.IntervalExpression
writing output... [ 79%] hail.expr.LocusExpression
writing output... [ 80%] hail.expr.NDArrayExpression
writing output... [ 80%] hail.expr.NDArrayNumericExpression
writing output... [ 80%] hail.expr.NumericExpression
writing output... [ 80%] hail.expr.SetExpression
writing output... [ 81%] hail.expr.StringExpression
writing output... [ 81%] hail.expr.StructExpression
writing output... [ 81%] hail.expr.TupleExpression
writing output... [ 82%] hail_on_the_cloud
writing output... [ 82%] index
writing output... [ 82%] install/azure
writing output... [ 82%] install/dataproc
writing output... [ 83%] install/linux
writing output... [ 83%] install/macosx
writing output... [ 83%] install/other-cluster
writing output... [ 84%] install/try
writing output... [ 84%] libraries
writing output... [ 84%] linalg/hail.linalg.BlockMatrix
writing output... [ 84%] linalg/index
writing output... [ 85%] linalg/utils/index
writing output... [ 85%] methods/genetics
writing output... [ 85%] methods/impex
writing output... [ 86%] methods/index
writing output... [ 86%] methods/misc
writing output... [ 86%] methods/relatedness
writing output... [ 86%] methods/stats
writing output... [ 87%] nd/index
writing output... [ 87%] other_resources
writing output... [ 87%] overview/expressions
writing output... [ 88%] overview/index
writing output... [ 88%] overview/matrix_table
writing output... [ 88%] overview/table
writing output... [ 89%] plot
writing output... [ 89%] root_api
writing output... [ 89%] scans
writing output... [ 89%] stats/hail.stats.LinearMixedModel
writing output... [ 90%] stats/index
writing output... [ 90%] tutorials-landing
writing output... [ 90%] tutorials/01-genome-wide-association-study
writing output... [ 91%] tutorials/03-tables
writing output... [ 91%] tutorials/04-aggregation
writing output... [ 91%] tutorials/05-filter-annotate
writing output... [ 91%] tutorials/06-joins
writing output... [ 92%] tutorials/07-matrixtable
writing output... [ 92%] tutorials/08-plotting
writing output... [ 92%] tutorials/09-ggplot
writing output... [ 93%] types
writing output... [ 93%] utils/index
writing output... [ 93%] vds/hail.vds.VariantDataset
writing output... [ 93%] vds/hail.vds.combiner.VDSMetadata
writing output... [ 94%] vds/hail.vds.combiner.VariantDatasetCombiner
writing output... [ 94%] vds/hail.vds.combiner.load_combiner
writing output... [ 94%] vds/hail.vds.combiner.new_combiner
writing output... [ 95%] vds/hail.vds.filter_chromosomes
writing output... [ 95%] vds/hail.vds.filter_intervals
writing output... [ 95%] vds/hail.vds.filter_samples
writing output... [ 95%] vds/hail.vds.filter_variants
writing output... [ 96%] vds/hail.vds.impute_sex_chr_ploidy_from_interval_coverage
writing output... [ 96%] vds/hail.vds.impute_sex_chromosome_ploidy
writing output... [ 96%] vds/hail.vds.interval_coverage
writing output... [ 97%] vds/hail.vds.lgt_to_gt
writing output... [ 97%] vds/hail.vds.local_to_global
writing output... [ 97%] vds/hail.vds.merge_reference_blocks
writing output... [ 97%] vds/hail.vds.read_vds
writing output... [ 98%] vds/hail.vds.sample_qc
writing output... [ 98%] vds/hail.vds.split_multi
writing output... [ 98%] vds/hail.vds.store_ref_block_max_length
writing output... [ 99%] vds/hail.vds.to_dense_mt
writing output... [ 99%] vds/hail.vds.to_merged_sparse_mt
writing output... [ 99%] vds/hail.vds.truncate_reference_blocks
writing output... [100%] vds/index

generating indices... genindex done
copying linked files... 
copying notebooks ... [ 12%] tutorials/01-genome-wide-association-study.ipynb
copying notebooks ... [ 25%] tutorials/03-tables.ipynb
copying notebooks ... [ 37%] tutorials/04-aggregation.ipynb
copying notebooks ... [ 50%] tutorials/05-filter-annotate.ipynb
copying notebooks ... [ 62%] tutorials/06-joins.ipynb
copying notebooks ... [ 75%] tutorials/07-matrixtable.ipynb
copying notebooks ... [ 87%] tutorials/08-plotting.ipynb
copying notebooks ... [100%] tutorials/09-ggplot.ipynb

highlighting module code... [  1%] hail.context
highlighting module code... [  3%] hail.experimental.datasets
highlighting module code... [  4%] hail.experimental.db
highlighting module code... [  6%] hail.experimental.export_entries_by_col
highlighting module code... [  7%] hail.experimental.expressions
highlighting module code... [  9%] hail.experimental.filtering_allele_frequency
highlighting module code... [ 11%] hail.experimental.full_outer_join_mt
highlighting module code... [ 12%] hail.experimental.import_gtf
highlighting module code... [ 14%] hail.experimental.ld_score_regression
highlighting module code... [ 15%] hail.experimental.ldscore
highlighting module code... [ 17%] hail.experimental.ldscsim
highlighting module code... [ 19%] hail.experimental.loop
highlighting module code... [ 20%] hail.experimental.pca
highlighting module code... [ 22%] hail.experimental.phase_by_transmission
highlighting module code... [ 23%] hail.experimental.plots
highlighting module code... [ 25%] hail.experimental.tidyr
highlighting module code... [ 26%] hail.experimental.time
highlighting module code... [ 28%] hail.expr.aggregators.aggregators
highlighting module code... [ 30%] hail.expr.builders
highlighting module code... [ 31%] hail.expr.expressions.base_expression
highlighting module code... [ 33%] hail.expr.expressions.expression_utils
highlighting module code... [ 34%] hail.expr.expressions.typed_expressions
highlighting module code... [ 36%] hail.expr.functions
highlighting module code... [ 38%] hail.expr.types
highlighting module code... [ 39%] hail.genetics.call
highlighting module code... [ 41%] hail.genetics.locus
highlighting module code... [ 42%] hail.genetics.pedigree
highlighting module code... [ 44%] hail.genetics.reference_genome
highlighting module code... [ 46%] hail.ggplot.aes
highlighting module code... [ 47%] hail.ggplot.coord_cartesian
highlighting module code... [ 49%] hail.ggplot.facets
highlighting module code... [ 50%] hail.ggplot.geoms
highlighting module code... [ 52%] hail.ggplot.ggplot
highlighting module code... [ 53%] hail.ggplot.labels
highlighting module code... [ 55%] hail.ggplot.scale
highlighting module code... [ 57%] hail.linalg.blockmatrix
highlighting module code... [ 58%] hail.linalg.utils.misc
highlighting module code... [ 60%] hail.matrixtable
highlighting module code... [ 61%] hail.methods.family_methods
highlighting module code... [ 63%] hail.methods.impex
highlighting module code... [ 65%] hail.methods.misc
highlighting module code... [ 66%] hail.methods.pca
highlighting module code... [ 68%] hail.methods.qc
highlighting module code... [ 69%] hail.methods.relatedness.identity_by_descent
highlighting module code... [ 71%] hail.methods.relatedness.king
highlighting module code... [ 73%] hail.methods.relatedness.mating_simulation
highlighting module code... [ 74%] hail.methods.relatedness.pc_relate
highlighting module code... [ 76%] hail.methods.statgen
highlighting module code... [ 77%] hail.nd.nd
highlighting module code... [ 79%] hail.plot.plots
highlighting module code... [ 80%] hail.stats.linear_mixed_model
highlighting module code... [ 82%] hail.table
highlighting module code... [ 84%] hail.utils.hadoop_utils
highlighting module code... [ 85%] hail.utils.interval
highlighting module code... [ 87%] hail.utils.misc
highlighting module code... [ 88%] hail.utils.struct
highlighting module code... [ 90%] hail.utils.tutorial
highlighting module code... [ 92%] hail.vds.combiner.variant_dataset_combiner
highlighting module code... [ 93%] hail.vds.functions
highlighting module code... [ 95%] hail.vds.methods
highlighting module code... [ 96%] hail.vds.variant_dataset
highlighting module code... [ 98%] hailtop.frozendict
highlighting module code... [100%] hailtop.fs.fs_utils

writing additional pages... search done
copying static files... done
copying extra files... done
dumping search index in English (code: en)... done
dumping object inventory... done
build finished with problems, 80 warnings.
make: *** [Makefile:52: html] Error 1
make: Leaving directory '/io/hail/python/hail/docs'

@danking
Copy link

danking commented Feb 2, 2024

Could things like this be an issue? I'd have expected the text to be indented.

@namurphy
Copy link

namurphy commented Feb 2, 2024

We had a similar problem come up over at XRTpy on this notebook and this other notebook, neither of which have any raw cells.

The error happened on both ubuntu-latest and macos-latest, but I was able to get rid of it by setting nbconvert < 7.14 in HinodeXRT/xrtpy#215.

This was the specific error that started showing up a bunch of times:

/Users/runner/work/xrtpy/xrtpy/docs/notebooks/data_analysis/Deconvolving_XRT_images.ipynb:129: ERROR: Content block expected for the "raw" directive; none found.

Thank you!

@mgeier
Copy link
Contributor

mgeier commented Feb 3, 2024

spatialaudio/nbsphinx#620 (comment) shows how to get the intermediate reST representation.

With an older nbconvert it looks something like this:

    .. raw:: text

          0%|          | 0/6 [00:00<?, ?it/s]

With a newer nbconvert, the status line starts with a '\x0d' character, a.k.a. "carriage return".
This seems to confuse the reST parser, because it messes up the indentation.

When copy-pasting it here, it get's messed up in a similar way (but apparently the actual carriage return character doesn't survive copy-pasting):

    .. raw:: text

        
  0%|          | 0/6 [00:00<?, ?it/s]

I'm not sure if nbconvert should remove that character from its output, but if not, I guess this has to be ignored in nbsphinx.

Note that I have not executed the notebook, I have used the pre-executed Check dead time model in Stingray.ipynb, which looks like this:

   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "\r",
      "  0%|          | 0/6 [00:00<?, ?it/s]"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "INFO: Calculating PDS model (update) [stingray.deadtime.model]\n"
     ]
    },

@matteobachetti
Copy link
Author

Ok, so it seems a problem with outputs containing an advancement bar from tqdm. Probably a good idea to ignore that carriage return, or to transform it in a new line maybe? Thanks for tracking this down!

elisno added a commit to elisno/cleanlab that referenced this issue Feb 16, 2024
Pin it to version 7.13 to avoid possible tqdm error, discussed in jupyter/nbconvert#2092

Maybe unrelated to weird tqdm outputs in notebook tutorials in the docs.
elisno added a commit to elisno/cleanlab that referenced this issue Feb 16, 2024
Pin it to version 7.13 to avoid possible tqdm error, discussed in jupyter/nbconvert#2092

Maybe unrelated to weird tqdm outputs in notebook tutorials in the docs.
elisno added a commit to cleanlab/cleanlab that referenced this issue Feb 16, 2024
Pin it to version 7.13 to avoid possible tqdm error, discussed in jupyter/nbconvert#2092

Maybe unrelated to weird tqdm outputs in notebook tutorials in the docs.
Zeitsperre added a commit to Ouranosinc/xclim that referenced this issue Feb 20, 2024
### What kind of change does this PR introduce?

* Pins nbconvert to prevent the documentation from failing on build.

### Does this PR introduce a breaking change?

No.

### Other information:

jupyter/nbconvert#2092
@mgeier
Copy link
Contributor

mgeier commented Apr 28, 2024

@blink1073 wrote:

Hi @matteobachetti, to be clear, it works with 7.13.1? I don't see anything in the 7.14 release itself that looks relevant.

I used git bisect to find that the culprit is ece13fd, a.k.a. #2089, created by @ryan-williams.

It would be great if the original coalescing behavior could be restored.

Maybe it's just a matter of moving the coalescing back to after the executing?

@mgeier
Copy link
Contributor

mgeier commented Apr 28, 2024

It looks like coalescing streams was originally enabled for the reST exporter and it was disabled in #2089.

This should fix the regression: #2142.

@matteobachetti
Copy link
Author

Thanks @mgeier!

@mgeier
Copy link
Contributor

mgeier commented Apr 29, 2024

nbconvert v7.16.4 has just been released and it should fix this problem. Can someone please confirm?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants