DIG - Data Independence Guidelines

classic Classic list List threaded Threaded
6 messages Options
Reply | Threaded
Open this post in threaded view
|

DIG - Data Independence Guidelines

Karl Dubost
FYI,
I published an old document [1] on data independence on GitHub [2] to ease collaboration and editing on it if necessary.

    Data Independence Guidelines (DIG) collects ideas around
    data independence. How to better share your data by
    promoting reusability, standards and clear policies. A
    series of best practices and tools for both the users
    (individual or structure) and service providers will be
    given.
    — https://github.com/karlcow/Data-Independence-Guidelines#readme

You may fork, create issues, send feedback.
The license is very permissive CC-BY 3.0.



[1]: http://www.la-grange.net/2009/02/16/data-independence
[2]: https://github.com/karlcow/Data-Independence-Guidelines


--
Karl Dubost
Montréal, QC, Canada
http://www.la-grange.net/karl/


Reply | Threaded
Open this post in threaded view
|

Re: DIG - Data Independence Guidelines

Glen Newton
As far as I can tell, I don't see 'data independence' defined in any
of your documents.
I think this would be helpful.

As someone who has spent 20+ years working in IT and data (big,
science, business, other), I have never encountered the term 'data
independence' used in the way you _appear_ to be using it.
The wikipedia definition appears to be different from what you are
referring to: https://secure.wikimedia.org/wikipedia/en/wiki/Data_independence

-Glen


On Mon, May 16, 2011 at 11:12 PM, Karl Dubost <[hidden email]> wrote:

> FYI,
> I published an old document [1] on data independence on GitHub [2] to ease collaboration and editing on it if necessary.
>
>    Data Independence Guidelines (DIG) collects ideas around
>    data independence. How to better share your data by
>    promoting reusability, standards and clear policies. A
>    series of best practices and tools for both the users
>    (individual or structure) and service providers will be
>    given.
>    — https://github.com/karlcow/Data-Independence-Guidelines#readme
>
> You may fork, create issues, send feedback.
> The license is very permissive CC-BY 3.0.
>
>
>
> [1]: http://www.la-grange.net/2009/02/16/data-independence
> [2]: https://github.com/karlcow/Data-Independence-Guidelines
>
>
> --
> Karl Dubost
> Montréal, QC, Canada
> http://www.la-grange.net/karl/
>
> _______________________________________________
> CivicAccess-discuss mailing list
> [hidden email]
> http://lists.pwd.ca/mailman/listinfo/civicaccess-discuss



--

-

Reply | Threaded
Open this post in threaded view
|

Re: DIG - Data Independence Guidelines

Karl Dubost
Glen,

Le 17 mai 2011 à 09:18, Glen Newton a écrit :
> As far as I can tell, I don't see 'data independence' defined in any
> of your documents.
> I think this would be helpful.

Good point. Would you create an issue :)
https://github.com/karlcow/Data-Independence-Guidelines/issues/new
List of previous issues.
https://github.com/karlcow/Data-Independence-Guidelines/issues

> As someone who has spent 20+ years working in IT and data (big,

As someone who has spent 15+ years working in Web standards and data ;)

> science, business, other), I have never encountered the term 'data
> independence' used in the way you _appear_ to be using it.
> The wikipedia definition appears to be different from what you are
> referring to: https://secure.wikimedia.org/wikipedia/en/wiki/Data_independence

Partly. A standardized format helps move data around and makes it easier for people to develop tools to import/export. They free the data from the software or material structure.
http://www.la-grange.net/2011/05/16/freedata/data-independence#data-export-format



--
Karl Dubost
Montréal, QC, Canada
http://www.la-grange.net/karl/


Reply | Threaded
Open this post in threaded view
|

Re: DIG - Data Independence Guidelines

Tracey P. Lauriault
I am by no means an expert in neither of your domains, however, in some respects, is this not overlap with OGC - http://www.opengeospatial.org/, kinda the data standards guru's in the geo world?

Also, with big science (Hadron Collider etc.) and in cartography, the data model, the software and the data are often inseparable - the output of these combined being the information.  Atlas data is useless in some respects with out the rendering of that data.  The Atlas is what matters, if you only have the data you do not have an atlas.

I know that I cannot flex my knowledge muscles like you fellahs,  but my hunch would lead me to look at OGC, the San Diego Centre for Super Computing and the like, NSDIC, most of the GRIDS, IPY (http://classic.ipy.org/international/joint-committee/data-management.htm) the US Cyberinfrastructure, what is done with remote sensing, NASA and even the itsy bitsy advances at the LAC Digital Format Registry - http://www.collectionscanada.gc.ca/digital-initiatives/012018-2210-e.html would ensure that no wheels are being reinvented.  There is also - OAIS - http://public.ccsds.org/publications/archive/650x0b1.PDF.

Again, just a hunch.

Cheers
t


On Tue, May 17, 2011 at 9:29 AM, Karl Dubost <[hidden email]> wrote:
Glen,

Le 17 mai 2011 à 09:18, Glen Newton a écrit :
> As far as I can tell, I don't see 'data independence' defined in any
> of your documents.
> I think this would be helpful.

Good point. Would you create an issue :)
https://github.com/karlcow/Data-Independence-Guidelines/issues/new
List of previous issues.
https://github.com/karlcow/Data-Independence-Guidelines/issues

> As someone who has spent 20+ years working in IT and data (big,

As someone who has spent 15+ years working in Web standards and data ;)

> science, business, other), I have never encountered the term 'data
> independence' used in the way you _appear_ to be using it.
> The wikipedia definition appears to be different from what you are
> referring to: https://secure.wikimedia.org/wikipedia/en/wiki/Data_independence

Partly. A standardized format helps move data around and makes it easier for people to develop tools to import/export. They free the data from the software or material structure.
http://www.la-grange.net/2011/05/16/freedata/data-independence#data-export-format



--
Karl Dubost
Montréal, QC, Canada
http://www.la-grange.net/karl/

_______________________________________________
CivicAccess-discuss mailing list
[hidden email]
http://lists.pwd.ca/mailman/listinfo/civicaccess-discuss



--
Tracey P. Lauriault
613-234-2805
Reply | Threaded
Open this post in threaded view
|

Re: DIG - Data Independence Guidelines

Karl Dubost

Le 17 mai 2011 à 10:05, Tracey P. Lauriault a écrit :
> not overlap with OGC - http://www.opengeospatial.org/, kinda the data standards guru's in the geo world?

Probably.
I should write a user story on the top of the document, a story which has already happened many times. Example: Magnolia bookmarking service which pooof disappeared from the network.

Imagine a user putting his/her own photo on Flickr after years a few gigas are there. Not only the photos, but the conversation, the tagging, the geolocation, etc. How do you make it possible for people to backup these data, to export them, to delete them. That the export is in a documented format, etc.

There will be loss, be the UI, the community of friends, etc, the goal is not to say "no more catastrophes", the goal is to say how do we evaluate the risks, and how do we make it possible for people to have a better understanding of their own data. The goal is to empower a bit more people.

Another example: For whoever has a kindle right now, how do you export all the data generated around the books you have read, annotations, quotes, etc in a documented format which could be parsed by a script. :)

As I said nothing utopian. :) just practical recipes.

--
Karl Dubost
Montréal, QC, Canada
http://www.la-grange.net/karl/


Reply | Threaded
Open this post in threaded view
|

Re: DIG - Data Independence Guidelines

Tracey P. Lauriault
Now that makes more sense!
 
That happened to me when a photosharing site that I was using went down.  I lost many great photos and even some projects!

On Tue, May 17, 2011 at 3:57 PM, Karl Dubost <[hidden email]> wrote:

Le 17 mai 2011 à 10:05, Tracey P. Lauriault a écrit :
> not overlap with OGC - http://www.opengeospatial.org/, kinda the data standards guru's in the geo world?

Probably.
I should write a user story on the top of the document, a story which has already happened many times. Example: Magnolia bookmarking service which pooof disappeared from the network.

Imagine a user putting his/her own photo on Flickr after years a few gigas are there. Not only the photos, but the conversation, the tagging, the geolocation, etc. How do you make it possible for people to backup these data, to export them, to delete them. That the export is in a documented format, etc.

There will be loss, be the UI, the community of friends, etc, the goal is not to say "no more catastrophes", the goal is to say how do we evaluate the risks, and how do we make it possible for people to have a better understanding of their own data. The goal is to empower a bit more people.

Another example: For whoever has a kindle right now, how do you export all the data generated around the books you have read, annotations, quotes, etc in a documented format which could be parsed by a script. :)

As I said nothing utopian. :) just practical recipes.

--
Karl Dubost
Montréal, QC, Canada
http://www.la-grange.net/karl/

_______________________________________________
CivicAccess-discuss mailing list
[hidden email]
http://lists.pwd.ca/mailman/listinfo/civicaccess-discuss



--
Tracey P. Lauriault
613-234-2805