A Common Data Architecture for Long Island

We've discussed previously on multiple posts the need to share data on Long Island (and to import relevant data from outside Long Island) and to analyze all in a rigorous and coordinated manner.

One possible method for attempting to gather and organize all relevant Long Island data is perhaps to develop universal or standard Long Island Metadata tags.

Another is to create a completely unique Long Island data architecture model which nevertheless is open and compatible with other data sources.

Then we ("Long Island 3.0") must partner with a flexible company or series of flexible companies in designing the proper methodology for vetting, accessing and analyzing this data (metadata) so that we arrive at a reasonable series of policy choices from which to decide.

While this may seem to be a monumental task, it is possible to accomplish this all in a reasonably short period of time.

All we need is leadership, focus and cooperation. The money, intelligence and organization is already in place to achieve the task at hand.

Putting the "public" in a public alert system

Remember the old Civil Defense concept?

Any "mass alert/communication" process should include the general public as a vital component. With the advent of the semantic web, data is broken up into smaller units which then may be reformed into metadata sets and other "use specific" tasks. It allows the web to become, in essence, one big relational database. (Click on image for a larger view).

Traditional organizations and government of course will play the primary role in any distribution of "official" data. But with more and more data becoming available and the ability to use this data becoming more flexible, it is probable that over the near term, the "general public" will use this new found freedom to create its own sophisticated information gathering and "alert" systems outside the traditional sources.

Common API: Part Two

Common or shared or open API are part of the process for producing usable data for productive analysis. "Recycling" analysis and policy determinations back into the mix are essential for maintaining the validity of current policies.

The above graphic is a preliminary look at the process. Click on it for a larger view.

Social Networking Theory and Long Island: Part One

"Social network theory look at the social structure between individuals or organizations. It investigates the ways in which they are connected through a variety of social commonalities. ... Social networking could also refer to a category of Internet based applications working to connect friends, business partners, or others using online interactions, forums, newsgroups, blogs, and a variety of other means..."

What is the composition of the social network or social networks of Long Island? How do we, as a region communicate with one another and with the "outside world?" Is there a Long Island "collective mind?" Will this "collective mind" eventually supplant traditional information and news sources?

Long Island is a diverse region and we protect our diversity and our individuality. No matter the community organization, government or media outlet, we strive to be the best. That should be a good thing and for the most part it is. But perhaps we, as a region are so competitive with one another we miss the greater opportunities cooperation offers.

Our previous posts on a LIWIKI and LI Metadata project and Virtual Community Congress are attempts to begin to forge the dichotomy between autonomy and coordinated efforts for the public good. In future posts we will try to tie this all together in a simple format.

Because as we all know, if it isn't simple to use and understand, it's probably doomed to failure. Not because of a lack of intelligence, just from a lack of time. Even with the best intentions these types of projects are difficult.

Can't hurt to try however.

Some additional current readings here, here, here and here.

Virtual "Community Congress": Part One

When I first wrote Oyster Bay 2000 in 1993, part of it included a "Community Congress." A Community Congress was simply a more organized way to to elicit productive ideas from the community's "best and brightest" and to foster interaction between community groups so that they may help one another where possible with government acting in a supporting rather than primary role.

It's not that government doesn't have a role, it's just that it is impossible for government to do everything that its citizens desire without having a significant tax impact. Also, there are a number of bright individuals in all our communities who have great ideas and services to offer, but may not have an organized forum to propose and debate these ideas and to offer these services. At the time I proposed the Community Congress, I conceived of it primarily as a body of individuals who actually "physically" met from time to time. But today, with the advancement in Web 2.0 and other technologies, perhaps a "virtual" Community Congress is a better choice as a primary mode of communication. A sort of better organized, standardized and more interactive "blogosphere" concept.

It's been my experience that most Long Island resident do wish to be cooperative productive citizens. They do, however, require information which is as accurate and unbiased as humanly possible. There is a profound distrust regarding information we receive from traditional sources and perhaps there always has been. How then do we begin the process of a more open dialogue? Is it even possible anymore to have productive dialogue not linked to individual personal advancement (or an organization's need to be influential) and the personal destruction of those we disagree with?

A tall order to be certain and one that will not be solved overnight or on one individuals or organization's timetable. I believe a good place to start is with the organization of data on Long Island and converting this Long Island data into a "dynamic" and "interactive" format (see LI Metadata). We need to establish ground rules and boundaries for us to begin the dialogue (some would say continue the dialogue) and have a long term, rational solution to problem solving which comports with short term and medium term needs and desires. Not easy, but necessary.

One of the best things about Long Island is its individuality and its abundant resources of some of the brightest people on the planet. Long Island is like one big abstract jig-saw puzzle of organizations and ideas. Going forward we hope to help construct a reasonable methodology for allowing these folks to help shape Long Island's bright future and solve the puzzle.

Long Island Metadata Project: Part One

"The simplest definition of metadata is that it is data about data."

Another useful tool in helping Long Island to "get organized" would be for some of our great colleges and universities in cooperation with state and local government and community organizations, to implement a Long Island Metadata Project (LIMDP). My apologies if someone is already doing this. I haven't come across it yet apart from some science related information. (Refer to Oyster Bay 2000 chart "Central Data Access/ Multi Platform" )

The LIMDP could established in conjunction with the SUNY Portal project (presuming it will be constructed to an "open architecture" platform) or as a different project based exclusively on Long Island with links to other projects. Perhaps the new LIFT Innovation Centers Project and other New York State NextGen Projects (both good variants of the Business Accelerator Model in The Port of Technology) could work cooperatively to create the correct environment of better communication. It seems Long Island and New York State have a lot of the correct elements in place and many very intelligent people from all walks of life ready to help our economy and our standard of living. We just need a little help organizing and working cooperatively to a achieve our goals (reference Oyster Bay 2000 "Community Congress" ).

Again the key is establishing a set of "open" standards and API that all such projects will adhere to. This still allow for creativity, competition and innovation while setting the framework for cooperation and information sharing and reasoned analysis. We still may not all agree on the results or how to proceed (human nature) but we are closer to having a unified approach to problem solving. When standards change in the future as inevitably they must, we then have a way to move together in unison rather than having to start from scratch.

Combined with XML, data mining and other relevant technologies, the LIDMP could be a simple and productive first step to having Long Islanders speak a common language and begin to chart a more productive course for our communities.