CSVW: CSV on the Web

[westurner]

• Read/write CSVW

  • Read CSVW
  • Write CSVW

CSVW

Homepage: https://w3c.github.io/csvw/
Standard: https://www.w3.org/TR/tabular-data-primer/
Standard: https://www.w3.org/TR/tabular-data-model/
Standard: https://www.w3.org/TR/tabular-metadata/
Standard: https://www.w3.org/TR/csv2json/
Standard: https://www.w3.org/TR/csv2rdf/
Namespace: http://www.w3.org/ns/csvw#
xmlns: @prefix csvw: <http://www.w3.org/ns/csvw#> .
@context: http://www.w3.org/ns/csvw.jsonld

CSVW (CSV on the Web) is a set of relatively new standards for representing CSV rows and columns as RDF (and JSON / JSON-LD) along with metadata.

• URIs for datatypes (XSD, ...)
• URIs for columns (RDF)
• Document Metadata
• CSV -> JSON ( -> JSON-LD -> RDF )
• CSV -> RDF

.

• https://wrdrd.github.io/docs/consulting/knowledge-engineering#csvw

[westurner]

From https://twitter.com/westurner/status/901988850330996736 :

@kennethreitz
SQL Query (from any DB) ⟿ Pandas DataFrame, in one line of code:
https://github.com/kennethreitz/records#records-sql-for-humans

@westurner
What about #CSVW #JSONLD? (#nbmeta #linkedreproducibility)

https://w3c.github.io/csvw/primer/

@kennethreitz
want to send a pull request?

@westurner
I'd like to. It may be good to get to 1.0 w/ #nbmeta (maybe retool w/ #attrs) result objects w/ repr_html (repr_rdfa_and_jsonld) be4

@kennethreitz
that'd be good! i just want to make sure curl/requests and friends get back data, not html

@westurner
"Model for Tabular Data and Metadata on the Web" (#JSONLD, #RDFa HTML) is for Data on the Web #dwbp #linkeddata
http://www.w3.org/TR/tabular-data-model/

@kennethreitz
sounds like something to add to tablib! http://docs.python-tablib.org/en/master/

@westurner
The challenge/opportunity is where to add the additional columnar metadata: {@sqlalchemy, #tablib,}

@westurner
"7 metadata header rows (column label, property URI path, DataType, unit, accuracy, precision, significant figures)"
https://wrdrd.github.io/docs/consulting/linkedreproducibility#csv-csvw-and-metadata-rows …

@kennethreitz
hmm, tablib is quite dumb when it comes to that stuff.... could autodetect if all columns match

@kennethreitz
or we just support strings out the gate and call it v0

@westurner
#CSVW defaults to xsd:string if unspecified.
"How do you support units of measure?" #qudt
https://www.w3.org/TR/tabular-data-primer/#units-of-measure

@kennethreitz
i say we stick to strings and call it v0 :)

[westurner]

@westurner
I'd like to. It may be good to get to 1.0 w/ #nbmeta (maybe retool w/ #attrs) result objects w/ repr_html (repr_rdfa_and_jsonld) be4

nbmeta: https://github.com/westurner/nbmeta

@westurner
#CSVW defaults to xsd:string if unspecified.

From https://www.w3.org/TR/tabular-data-primer/#datatypes 👍

NOTE
You don't have to include "datatype": "string" for columns that are strings — columns are assumed to hold strings if no datatype is explicitly specified.

[kennethreitz]

this sounds awesome!

[westurner]

Unfortunately I don't know when I'll be able to get to this while job searching.

…

On Thursday, August 31, 2017, Kenneth Reitz ***@***.***> wrote: this sounds awesome! — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <https://github.com/kennethreitz/tablib/issues/305#issuecomment-326480489>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AADGy9bcXuifI956S5qCu2vlKN2f0TmRks5sd388gaJpZM4PJoIM> .

[westurner]

@westurner
I'd like to. It may be good to get to 1.0 w/ #nbmeta (maybe retool w/ #attrs) result objects w/ repr_html (repr_rdfa_and_jsonld) be4

attrs

• Src: https://github.com/python-attrs/attrs
• Docs: https://attrs.readthedocs.io/en/stable/
• Docs: https://attrs.readthedocs.io/en/stable/examples.html#metadata
• Docs: https://attrs.readthedocs.io/en/stable/extending.html#extending-metadata

[farhaanbukhsh]

hey @westurner and @hugovk, I would like to collaborate on this feature and get it up and going. Can you guys guide me or may be point me in the right direction to start this. Thanks in advance. 😃

[hugovk]

Have a look at the dev docs:

• https://tablib.readthedocs.io/en/stable/development/

[farhaanbukhsh]

@hugovk thanks for pointing this to me will try to do a WIP and then we can take this ahead.