I heard the sad news about Robert Pirsig passing.
His book : Zen and the art of motorcycle maintenance was a big influence on me and piqued my interest in philosophy.
While writing the book his day job was writing computer manuals.
About 15 years ago, I wrote an article for ITWorld about data modelling with XML called Zen and the art of motorcycle manuals, inspired in part by Pirsig's book and his meditations on how the qualities in objects such as motorcycles are more than just the sum of the parts that make up the motorcycle.
So it is with data modelling. For any given modelling problem there are many ways to do it that are all "correct" at some level. Endlessly seeking to bottom out the search and find the "correct" model is a pointless exercise. At the end of the day "correctness" for any data model is not a function of the data itself. It is a function of what you are planning to do with the data.
This makes some folks uncomfortable. Especially proponents of top-down software development methodologies who like to conceptualize analysis as an activity that starts and ends before any prototyping/coding begins.
Maybe somewhere out there Robert Pirsig is talking with Bill Kent - author of another big influence on my thinking : Data and Reality.
Maybe they are discussing how best to model a bishop :-)
Featured Post
These days, I mostly post my tech musings on Linkedin. https://www.linkedin.com/in/seanmcgrath/
Wednesday, April 26, 2017
Friday, April 21, 2017
What is law? - Part 10
Previously: What is Law? - Part 9
Earlier on in this series, we imagined an infinitely patient and efficient person who has somehow managed to acquire the entire corpus of law at time T and has read it all for us and can now "replay" it to us on demand. We mentioned previously that the corpus is not a closed world and that meaning cannot really be locked down inside the corpus itself. It is not corpus of mathematical truths, dependent only on a handful of axioms. This is not a bug to be fixed. It is a feature to be preserved.
We know we need to add a layer of interpretation and we recognize from the outset that different people (or different software algorithms) could take this same corpus and interpret it differently. This is ok because, as we have seen, it is (a) necessary and (b) part of the way law actually works. Interpreters differ in the opinions they arrive at in reading the corpus. Opinions get weighed against each other, opinions can be over-ruled by higher courts. Some courts can even over-rule their own previous opinions. Strongly established opinions may then end up appearing directly in primary law or regulations, new primary legislation might be created to clarify meaning...and the whole opinion generation/adjudication/synthesis loop goes round and round forever... In law, all interpretation is contemporaneous, tentative and de-feasible. There are some mathematical truths in there but not many.
It is tempting - but incorrect in my opinion - to imagine that the interpretation process works with the stream of words coming into our brains off of the pages, that then get assembled into sentences and paragraphs and sections and so on in a straightforward way.
The main reason it is not so easy may be surprising. Tables! The legal corpus is awash with complex table layouts. I included some examples in a previous post about the complexties of law[1]. The upshot of the use of ubiquitous use of tables is that reading law is not just about reading the words. It is about seeing the visual layout of the words and associating meaning with the layout. Tables are such a common tool in legal documents that we tend to forget just how powerful they are at encoding semantics. So powerful, that we have yet to figure out a good way of extracting back out the semantics that our brains can readily see in law, using machines to do the "reading".
Compared to, say, detecting the presence of headings or cross-references or definitions, correctly detecting the meaning implicit in the tables is a much bigger problem. Ironically, perhaps, much bigger than dealing with high visual items such as maps in redistricting legislation[2] because the actual redistricting laws are generally expressed purely in words using, for example, eastings and northings to encode the geography.
If I could wave a magic wand just once at the problem of digital representation of the legal corpus I would wave it at the tables. An explicit semantic representation of tables, combined with some controlled natural language forms[4] would be, I believe, as good a serialization format as we could reasonably hope for, for digital law. It would still have the Closed World of Knowledge problem of course. It would also still have the Unbounded Opinion Requirement but at least we would be in position to remove most of the need for a visual cortex in this first layer of interpreting and reasoning about the legal corpus.
The benefits to computational law would be immense. We could imagine a digital representation of the corpus of law as an enormous abstract syntax tree[5] which we could begin to traverse to get to the central question about how humans traverse this tree to reason about it, form opinions about it, and create legal arguments in support of their opinions.
Next up: What is law? - Part 11.
[1] http://seanmcgrath.blogspot.ie/2010/06/xml-in-legislatureparliament_04.html
[2] https://ballotpedia.org/Redistricting
[3] https://en.wikipedia.org/wiki/Easting_and_northing
[4] https://en.wikipedia.org/wiki/Controlled_natural_language
[5] https://en.wikipedia.org/wiki/Abstract_syntax_tree
Earlier on in this series, we imagined an infinitely patient and efficient person who has somehow managed to acquire the entire corpus of law at time T and has read it all for us and can now "replay" it to us on demand. We mentioned previously that the corpus is not a closed world and that meaning cannot really be locked down inside the corpus itself. It is not corpus of mathematical truths, dependent only on a handful of axioms. This is not a bug to be fixed. It is a feature to be preserved.
We know we need to add a layer of interpretation and we recognize from the outset that different people (or different software algorithms) could take this same corpus and interpret it differently. This is ok because, as we have seen, it is (a) necessary and (b) part of the way law actually works. Interpreters differ in the opinions they arrive at in reading the corpus. Opinions get weighed against each other, opinions can be over-ruled by higher courts. Some courts can even over-rule their own previous opinions. Strongly established opinions may then end up appearing directly in primary law or regulations, new primary legislation might be created to clarify meaning...and the whole opinion generation/adjudication/synthesis loop goes round and round forever... In law, all interpretation is contemporaneous, tentative and de-feasible. There are some mathematical truths in there but not many.
It is tempting - but incorrect in my opinion - to imagine that the interpretation process works with the stream of words coming into our brains off of the pages, that then get assembled into sentences and paragraphs and sections and so on in a straightforward way.
The main reason it is not so easy may be surprising. Tables! The legal corpus is awash with complex table layouts. I included some examples in a previous post about the complexties of law[1]. The upshot of the use of ubiquitous use of tables is that reading law is not just about reading the words. It is about seeing the visual layout of the words and associating meaning with the layout. Tables are such a common tool in legal documents that we tend to forget just how powerful they are at encoding semantics. So powerful, that we have yet to figure out a good way of extracting back out the semantics that our brains can readily see in law, using machines to do the "reading".
Compared to, say, detecting the presence of headings or cross-references or definitions, correctly detecting the meaning implicit in the tables is a much bigger problem. Ironically, perhaps, much bigger than dealing with high visual items such as maps in redistricting legislation[2] because the actual redistricting laws are generally expressed purely in words using, for example, eastings and northings to encode the geography.
If I could wave a magic wand just once at the problem of digital representation of the legal corpus I would wave it at the tables. An explicit semantic representation of tables, combined with some controlled natural language forms[4] would be, I believe, as good a serialization format as we could reasonably hope for, for digital law. It would still have the Closed World of Knowledge problem of course. It would also still have the Unbounded Opinion Requirement but at least we would be in position to remove most of the need for a visual cortex in this first layer of interpreting and reasoning about the legal corpus.
The benefits to computational law would be immense. We could imagine a digital representation of the corpus of law as an enormous abstract syntax tree[5] which we could begin to traverse to get to the central question about how humans traverse this tree to reason about it, form opinions about it, and create legal arguments in support of their opinions.
Next up: What is law? - Part 11.
[1] http://seanmcgrath.blogspot.ie/2010/06/xml-in-legislatureparliament_04.html
[2] https://ballotpedia.org/Redistricting
[3] https://en.wikipedia.org/wiki/Easting_and_northing
[4] https://en.wikipedia.org/wiki/Controlled_natural_language
[5] https://en.wikipedia.org/wiki/Abstract_syntax_tree
Wednesday, April 19, 2017
What is law? - Part 9
Previously: What is law? - Part 8
For the last while, we have been thinking about the issues involved in interpreting the corpus of legal materials that is produced by the various branches of government in US/UK style environments. As we have seen, it is not a trivial exercise because of the ways the material is produced and because the corpus - by design - is open to different interpretations and open to interpretation changing with respect to time. Moreover, it is not an exaggeration to say that it is a full time job - even within highly specialized sub-topics of law - to keep track of all the changes and synthesize the effects of these changes into contemporaneous interpretations.
For quite some time now - centuries in some cases - a second legal corpus has evolved in the private sector. This secondary corpus serves to consolidate and package and interpret the primary corpus, so that lawyers can focus on the actual practice of law. Much of this secondary corpus started out as paper publications, often with so-called loose-leaf update cycles. These days most of this secondary corpus is in the form of digital subscription services. The vast majority of lawyers utilize these secondary sources from legal publishers. So much so that over the long history of law, a number of interesting side-effects have accrued.
Firstly, for most day-to-day practical purposes, the secondary corpus provides de-facto consolidations and interpretations of the primary corpus. I.e. although the secondary sources are not "the law", they effectively are. The secondary sources that are most popular with lawyers are very high quality and have earned a lot of trust over the years from the legal community.
In this respect, the digital secondary corpus of legal materials is similar to modern day digital abstractions of currency such as bank account balances and credit cards etc. I.e. we trust that there are underlying paper dollars that correspond to the numbers moving around digital bank accounts. We trust that the numbers moving around digital bank accounts could be redeemed for real paper dollars if we wished. We trust that the real paper dollars can be used in value exchanges. So much so, that we move numbers around bank accounts to achieve value exchange without ever looking to inspect the underlying paper dollars. The digital approach to money works because it is trusted. Without the trust, it cannot work. The same is true for the digital secondary corpus of law, it works because it is trusted.
A second, interesting side-effect of trust in the secondary corpus is that parts of it have become, for all intents and purposes, the primary source. If enough of the worlds legal community is using secondary corpus X then even if that secondary corpus differs from the primary underlying corpus for some reason, it may not matter in practice because everybody is looking at the secondary corpus.
A third, interesting side effect of the digital secondary corpus is that it has become indispensable. The emergence of a high quality inter-mediating layer between primary legal materials and legal practitioners has made it possible for the world of law to manage greater volumes and greater change rates in the primary legal corpus. Computer systems have greatly extended this ability to cope with volume and change. So much so, that law as it is today would collapse if it were not for the inter-mediating layer and the computers.
The classic image of a lawyers office involves shelves upon shelves of law books. For a very long time now, those shelves have featured a mix of primary legal materials and secondary materials from third party publishers. For a very long time now, the secondary materials have been the day-to-day "go to" volumes for legal practitioners - not the primary volumes. Over the last 50 years, the usage level of these paper volumes has dwindled year on year to the point where today, the beautiful paper volumes have become primarily interior decoration in law offices. The real day-to-day corpus is the digital versions and most of those digital resources are from the secondary - not the primary legal sources.
So, in a sense, the law has already been inter-mediated by a layer of interpretation. In some cases the secondary corpus has become a de-facto primary source by virtue of its ubiquity and the trust placed in it by the legal community.
This creates and interesting dilemma for our virtual legal reasoning machine. The primary legal corpus - as explained previously - is not at all an easy thing to get your hands on from the government entities that produce it. And even if you did get it, it might not be what lawyers would consider the primary authority anyway. On the other hand, the secondary corpus is not a government-produced corpus and may not be available at all outside of the private world of one of the major legal publishers.
The same applies for the relatively new phenomenon of computer systems encoding parts of the legal corpus into computational logic form. Classic examples of this include payroll/income tax and eligibility determinations. These two sub-genres of law tend to have low representational complexity[1]. Simply put, they can readily be converted into programming languages as they are mostly mathematical with low dependencies on the outside world.
Any encoding of the primary legal text into a computer program is, itself, an interpretation. Remembering back to the Unbounded Opinion Requirement, programmers working with legal text are - necessarily encoding opinions as to what the text means. It does not matter if this encoding process is being performed by a government agency or by a third party, it is still an interpretation.
These computer programs - secondary sources of interpretation - can become de-facto interpretations if enough of the legal community trusts them. Think of the personal taxes software applications and e-Government forms for applying for various government services. If enough of the community use these applications, they become de-facto interpretations.
The legal concept of interpretation forebearance applies here. If a software application interprets a tax deduction in a particular way that is reasonable it may be allowed *even* if a tax inspector would have interpreted the deduction differently.
I am reminded of the concept of reference implementations as forms of specification in computer systems. Take Java Server Pages for an example. If you have a query as to what a Servlet Engine should do in some circumstance, how do you find out what the correct behavior is? It is not in the documentation. It is in the *reference implementation* which is Apache Tomcat.
I am also reminded of the SEC exploring the use of the Python programming language as the legal expression of complex logic in asset backed securties[2]. On the face of it, this would be better than English prose, right? How much more structured can you get than expressing it in a programming language? Well, what version of Python are you talking about? Python 2 family? The Python 3 family? Jython? Is it possible the same same program text can produce different answers if you interprert it with different interpreters? Yes, absolutely. Is it possible, to get different answers from the same code running the same interpreter on different operating systems? Again, yes, absolutely. What about running it tomorrow rather than today? Yes, again!
Even programming languages need interpretation and correct behavior is difficult - perhaps impossible - to capture in the abstract - especially when the program cannot be expressed in a fully closed world without external dependencies. Echoing Wittgenstein again, the true meaning of a computer program manifests when you run it, not in the syntax:-) The great mathematician and computer scientist Don Knuth once warned users of a program that he had written to be careful as he had only proven it to be correct, but had not tried it out.[3]
By now, I hope I have established a reasonable defense of my belief that establishing the meaning of the legal corpus is a tricky business. The good news is that creating interpretations of the corpus is not a new idea. In fact it has been going on for centuries. Moreover, in recent decades, some of the corpus has gradually crept into the form of computer programs and even though it is still rare to find a computer program given formal status in primary law, computer programs are increasingly commonplace in the secondary corpus where they have de-facto status. I hope I have succeeded in explaining why conversions into computer program form do not magically remove the need for interpretation and in some respects just move the interpretation layer around, rather than removing it.
So where does all this leave our legal reasoning black box? I think it leaves it in good shape actually, because we have been using variations on the reasoning black box for centuries. Every time we rely on a third party aggregation or consolidation or digitization or commentary, we are relying on an interpretation. Using a computer to do it, just makes it better/faster/cheaper but it is a well, well established paradigm at this point. A paradigm already so entrenched that the modern world of law could not operate without it. All the recent interest in computational law, artificial intelligence, smart contracts etc. is not a radically new concept. It is really just a recent rapid acceleration of a trend that started its acceleration in the Seventies with the massive expansion in the use of secondary sources that was ushered in by the information age.
So, we are just about ready, I think, to tackle the question of how our virtual legal reasoning box should best go about the business of interpreting the legal corpus. The starting point for this will be to take a look at how humans do it and will feature a perhaps surprising detour into cognitive psychology for some unsettling facts about human reasoning actually works. Hint: its not all tidy logical rules and neatly deductive logic.
This is where we will pick up in Part 10.
[1] http://web.stanford.edu/group/codex/cgi-bin/codex/wp-content/uploads/2014/01/p193-surden.pdf
[2] https://www.sec.gov/rules/proposed/2010/33-9117.pdf
[3] https://en.wikiquote.org/wiki/Donald_Knuth
For the last while, we have been thinking about the issues involved in interpreting the corpus of legal materials that is produced by the various branches of government in US/UK style environments. As we have seen, it is not a trivial exercise because of the ways the material is produced and because the corpus - by design - is open to different interpretations and open to interpretation changing with respect to time. Moreover, it is not an exaggeration to say that it is a full time job - even within highly specialized sub-topics of law - to keep track of all the changes and synthesize the effects of these changes into contemporaneous interpretations.
For quite some time now - centuries in some cases - a second legal corpus has evolved in the private sector. This secondary corpus serves to consolidate and package and interpret the primary corpus, so that lawyers can focus on the actual practice of law. Much of this secondary corpus started out as paper publications, often with so-called loose-leaf update cycles. These days most of this secondary corpus is in the form of digital subscription services. The vast majority of lawyers utilize these secondary sources from legal publishers. So much so that over the long history of law, a number of interesting side-effects have accrued.
Firstly, for most day-to-day practical purposes, the secondary corpus provides de-facto consolidations and interpretations of the primary corpus. I.e. although the secondary sources are not "the law", they effectively are. The secondary sources that are most popular with lawyers are very high quality and have earned a lot of trust over the years from the legal community.
In this respect, the digital secondary corpus of legal materials is similar to modern day digital abstractions of currency such as bank account balances and credit cards etc. I.e. we trust that there are underlying paper dollars that correspond to the numbers moving around digital bank accounts. We trust that the numbers moving around digital bank accounts could be redeemed for real paper dollars if we wished. We trust that the real paper dollars can be used in value exchanges. So much so, that we move numbers around bank accounts to achieve value exchange without ever looking to inspect the underlying paper dollars. The digital approach to money works because it is trusted. Without the trust, it cannot work. The same is true for the digital secondary corpus of law, it works because it is trusted.
A second, interesting side-effect of trust in the secondary corpus is that parts of it have become, for all intents and purposes, the primary source. If enough of the worlds legal community is using secondary corpus X then even if that secondary corpus differs from the primary underlying corpus for some reason, it may not matter in practice because everybody is looking at the secondary corpus.
A third, interesting side effect of the digital secondary corpus is that it has become indispensable. The emergence of a high quality inter-mediating layer between primary legal materials and legal practitioners has made it possible for the world of law to manage greater volumes and greater change rates in the primary legal corpus. Computer systems have greatly extended this ability to cope with volume and change. So much so, that law as it is today would collapse if it were not for the inter-mediating layer and the computers.
The classic image of a lawyers office involves shelves upon shelves of law books. For a very long time now, those shelves have featured a mix of primary legal materials and secondary materials from third party publishers. For a very long time now, the secondary materials have been the day-to-day "go to" volumes for legal practitioners - not the primary volumes. Over the last 50 years, the usage level of these paper volumes has dwindled year on year to the point where today, the beautiful paper volumes have become primarily interior decoration in law offices. The real day-to-day corpus is the digital versions and most of those digital resources are from the secondary - not the primary legal sources.
So, in a sense, the law has already been inter-mediated by a layer of interpretation. In some cases the secondary corpus has become a de-facto primary source by virtue of its ubiquity and the trust placed in it by the legal community.
This creates and interesting dilemma for our virtual legal reasoning machine. The primary legal corpus - as explained previously - is not at all an easy thing to get your hands on from the government entities that produce it. And even if you did get it, it might not be what lawyers would consider the primary authority anyway. On the other hand, the secondary corpus is not a government-produced corpus and may not be available at all outside of the private world of one of the major legal publishers.
The same applies for the relatively new phenomenon of computer systems encoding parts of the legal corpus into computational logic form. Classic examples of this include payroll/income tax and eligibility determinations. These two sub-genres of law tend to have low representational complexity[1]. Simply put, they can readily be converted into programming languages as they are mostly mathematical with low dependencies on the outside world.
Any encoding of the primary legal text into a computer program is, itself, an interpretation. Remembering back to the Unbounded Opinion Requirement, programmers working with legal text are - necessarily encoding opinions as to what the text means. It does not matter if this encoding process is being performed by a government agency or by a third party, it is still an interpretation.
These computer programs - secondary sources of interpretation - can become de-facto interpretations if enough of the legal community trusts them. Think of the personal taxes software applications and e-Government forms for applying for various government services. If enough of the community use these applications, they become de-facto interpretations.
The legal concept of interpretation forebearance applies here. If a software application interprets a tax deduction in a particular way that is reasonable it may be allowed *even* if a tax inspector would have interpreted the deduction differently.
I am reminded of the concept of reference implementations as forms of specification in computer systems. Take Java Server Pages for an example. If you have a query as to what a Servlet Engine should do in some circumstance, how do you find out what the correct behavior is? It is not in the documentation. It is in the *reference implementation* which is Apache Tomcat.
I am also reminded of the SEC exploring the use of the Python programming language as the legal expression of complex logic in asset backed securties[2]. On the face of it, this would be better than English prose, right? How much more structured can you get than expressing it in a programming language? Well, what version of Python are you talking about? Python 2 family? The Python 3 family? Jython? Is it possible the same same program text can produce different answers if you interprert it with different interpreters? Yes, absolutely. Is it possible, to get different answers from the same code running the same interpreter on different operating systems? Again, yes, absolutely. What about running it tomorrow rather than today? Yes, again!
Even programming languages need interpretation and correct behavior is difficult - perhaps impossible - to capture in the abstract - especially when the program cannot be expressed in a fully closed world without external dependencies. Echoing Wittgenstein again, the true meaning of a computer program manifests when you run it, not in the syntax:-) The great mathematician and computer scientist Don Knuth once warned users of a program that he had written to be careful as he had only proven it to be correct, but had not tried it out.[3]
By now, I hope I have established a reasonable defense of my belief that establishing the meaning of the legal corpus is a tricky business. The good news is that creating interpretations of the corpus is not a new idea. In fact it has been going on for centuries. Moreover, in recent decades, some of the corpus has gradually crept into the form of computer programs and even though it is still rare to find a computer program given formal status in primary law, computer programs are increasingly commonplace in the secondary corpus where they have de-facto status. I hope I have succeeded in explaining why conversions into computer program form do not magically remove the need for interpretation and in some respects just move the interpretation layer around, rather than removing it.
So where does all this leave our legal reasoning black box? I think it leaves it in good shape actually, because we have been using variations on the reasoning black box for centuries. Every time we rely on a third party aggregation or consolidation or digitization or commentary, we are relying on an interpretation. Using a computer to do it, just makes it better/faster/cheaper but it is a well, well established paradigm at this point. A paradigm already so entrenched that the modern world of law could not operate without it. All the recent interest in computational law, artificial intelligence, smart contracts etc. is not a radically new concept. It is really just a recent rapid acceleration of a trend that started its acceleration in the Seventies with the massive expansion in the use of secondary sources that was ushered in by the information age.
So, we are just about ready, I think, to tackle the question of how our virtual legal reasoning box should best go about the business of interpreting the legal corpus. The starting point for this will be to take a look at how humans do it and will feature a perhaps surprising detour into cognitive psychology for some unsettling facts about human reasoning actually works. Hint: its not all tidy logical rules and neatly deductive logic.
This is where we will pick up in Part 10.
[1] http://web.stanford.edu/group/codex/cgi-bin/codex/wp-content/uploads/2014/01/p193-surden.pdf
[2] https://www.sec.gov/rules/proposed/2010/33-9117.pdf
[3] https://en.wikiquote.org/wiki/Donald_Knuth
Friday, April 14, 2017
What is law? - part 8
Previously: what is law? - Part 7.
A good place to
start in exploring the Closed World of Knowledge (CWoK) problem in
legal knowledge representation is to consider the case of a spherical
cow in a vacuum...
Say what? The
spherical cow in a vacuum[1] is a well known humorous metaphor for
a
very important fact about the physical world. Namely, any model we
make of something
in the physical world, any representation of it we
make inside a mathematical
formula or a computer program, is
necessarily based on simplifications (a "closed world") to
make the representation tractable.
The statistician
George Box once said that "all models are wrong, but some are
useful." Although this mantra is generally applied in the
context of applied math and physics, this concept is
incredibly
important in the world of law in my opinion. Law can usefully be
thought of as an
attempt at steering the future direction of the
physical world in a particular direction.
It does this by attempting
to pick out key features of the real world (e.g. people, objects,
actions, events) and making statements about how these things ought
to inter-relate (e.g. if event E happens, person P must perform
action A with object O).
Back to cows now.
Given that the law may want to steer the
behavior of the world with
respect to cows, for example, tax them, regulate how they
are
treated, incentivize cow breeding programs etc. etc., how does law
actually
speak about cows? Well, we can start digging through legislative texts to find out but
what we will find is not the raw
material from which to craft a good definition
of a cow for the
purposes of a digital representation of it. Instead, we will find
some or all of the following:
- Statements about cows that do not define cows at all but proceed to make statements about them as if we all know exactly what is a cow and what is not a cow
- Statements that "zoom in" in cow-ness without actually saying "cow" explicitly e.g. "animals kept on farms", "milk producers" etc,
- Statements that punt on the definition of a cow by referencing the definition in some outside authority e.g. an agricultural taxonomy
- Statements that "zoom in" on cow-ness by analogies to other animals eg. "similar in size to horses, bison and camels."
- Statements that define cows to be things other than cows(!) e.g. "For the purposes of this section, a cow is any four legged animal that eats grass."
What you will not
find anywhere in the legislative corpus, is a nice tidy, self
contained
mathematical object denoting a cow, fully encapsulated in
a digital form. Why? Well, the only way we could
possibly do that
would be to make a whole bunch of simplifications on "cow-ness"
and we know
where that ends up. It ends up with spherical objects in
vacuums just as it does
in the world of physics! There is simply no
closed world model of a cow that captures everything
we might want
to capture about cows in laws about cows.
Sure, we could keep
adding to the model of a cow, refining it, getting
it close and
closer to cow-ness. However, we know from the experience of the world
of physics that we reach the point where have to stop, because it is
a bottomless refinement process.
This might sound
overly pessimistic or pedantic and in the case of
cows for
legislative purposes it clearly is, but I am doing it to make a
point. Even everyday concepts in law such as aviation,
interest rates and theft are too complex (in the
mathematical sense of complex) to be defined inside self-contained
models.
Again, fractals
spring to mind. We can keep digging down into the fractal boundary that splits the world into cow and not-cow. Refining our definitions until
the cows come home (sorry, could not resist) and we will never reach
the end of the refinement process. Moreover many of the
real world phenomena law wants to talk about exhibit a phenomenon
known as "sensitivity to initial conditions"[3]. It turns
our that really, really small differences in the state of the world
when an event kicks off, can result is completely different outcomes
for the same event. This is why, in the case of aviation for
example,
mathematical models of the behavior of an aircraft wing can
only get you so far. There
comes a point where the only way to find
out what will happen in the real world is to
try it in the real
world (for example, in a wind tunnel.)
So it is with law. Small
changes in any definitions of people, objects, actions, events, can
lead to very different outcomes. The sensitivity to initial conditions means that it is not possible to fully "steer" outcomes by refining the state of affairs to greater and greater depth. Outcomes are going to be unpredictable, no matter how hard you work on refining your model.
We can come at this
CWoK problem from a number of other perspectives, each of which
shine
extra light on the representation problem. From a linguistics
perspective, in
searching for a definition of "cow" we can
end up in some familiar territory.
For Sausserre[4] for example,
words have meaning as a result of their differences...from
other
words:-) Think of a dictionary that has all the words in the English
language
in it. Each word is explained....in terms of other words! Simply put, language does not appear to be a system of symbols that gets its meaning by mapping it onto the world. It gets is meaning by mapping back onto itself.
From a philosophical
perspective, trying to figure out what a word like "cow"
actually
means has been a field of study for thousands of years. It
is surprising tricky[5], especially
when you add in the extra
dimension of time as Searle does with the concept of Rigid
Designation[6].
Fusing philosophy
and linguisics, Charles Sanders Pierce noted
that nothing exists
independently. I.e. everything we might put a name on only
exits in
relation to the other things we put names on[9]
. We can approach the
same idea from an almost mystical/religious perspective and find
ourselves questioning the very existence of cows:-) Take a look at
this picture
from Zen Master Steve Hagen for example[8] Do you see a
cow? Some people will, some
will not. How can we ever hope to
produce a good enough representation of a cow
unless we all share
the same mental ability to split the world between cow and non-cow?
Echoing Charles
Sanders Pierce, we find the ancient Eastern concept of dependent
origination[10]. Everything that we think exists, only exists in
relation to other
things that we think exist. Not only that, but
because everything is constantly changing with respect to
time, the
relationships between the things – and thus their very definitions
- keep changing too.
This is essentially
where philosopher
John Searle ends up in his book Naming and
Necessity[11]. For Searle, the meaning of nouns, ultimately,
is a
social convention and meaning *changes* as social convention changes.
One final
philosophical reference and then we will move on.
Wittgenstein famously stated that
the meaning of language can only
be found in how it is used - not in dictionaries[12].
As with
Pierce, the meaning can change as the usage changes.
This doesn't sound
very promising does it?
How can law do its job if even the simple
sounding concept of rigorously defining terms is intractable? Law does
it by not getting caught up in formal definitions and formal logic at
all. Instead, the world of law takes the view that it is better to
leave a lot of interpretation to a layer of processing that is
outside the legal corpus itself. Namely, the opinions formed by
lawyers and judges. The way the system works is that two lawyers,
looking at the same corpus of legal materials can arrive at different
conclusions as to what it all means and this is ok. This is not a
bug. It is a feature. Perhaps the feature of law that
differentiates it from classical computing.
The law does not
work by creating perfect unambiguous definitions of things in the
world and states of affairs in the world. It works by sketching these
things out in human language and then letting the magic of human
language do its thing. Namely, allowing different people to interpret
the same material differently. In law, what matters is not that the
legal corpus itself spells everything out in infinite detail. What
matters is that humans (and increasingly, cognitively augmented
humans) can form opinions as to meaning and then defend those
opinions to other humans. This is the concept of legal argumentation
in a nutshell. It is not just inductive reasoning[13], taking a big
corpus of rules and a corpus of facts and “cranking the handle”
to get an answer to a question. It is, in large part, abductive
reasoning[14] in which legislation, regulations, caselaw are analyzed
and used to construct an argument in favour of a particular
interpretation of the corpus.
That is why parties to a legal event
such as a contract or a court case have their own lawyers (at least
in the US/UK common law style of legal system). It is an adversarial
system [15] in which each legal team does its best to interpret the
corpus of law in the way that best serves their team. The job of the
judge then is to decide which legal argument – which interpretation
of the corpus presented by the legal teams – is most persuasive.
This is what I think
of as the Unbounded Opinion Requirement (UoR) of law.
This UoR
aspect, kicks in very, very quickly in the world of law because the
corpus – for reasons we have talked about – doesn't feature the
clear cut definitions and mathematically based rules that computer
people are so fond of. The corpus of law, does not spell out its own
interpretation. It cannot be “structured” in the sense that
computer people tend to think of structure. It has as many possible
interpretations as there are humans – or computers - to read it and
construct defenses for their particular interpretations.
I have been arguing that a “golden” interpretation cannot be in the legal corpus itself, but I think it is actually true that even if it could, it should not be. The reasons for this relate to how the corpus evolves over time and how interpretation itself evolves over time and that this is actually a very good thing.
I have been arguing that a “golden” interpretation cannot be in the legal corpus itself, but I think it is actually true that even if it could, it should not be. The reasons for this relate to how the corpus evolves over time and how interpretation itself evolves over time and that this is actually a very good thing.
A classic example of
a legal statement that drives computer people to distraction is a
statement like “A shall communicate with B in a reasonable amount
of time and make a fair market value offer for X.” What does
“reasonable amount of time” mean? What does “fair market value”
mean?
A statement like
“reasonable amount of time” for A to communicate with B is a good
example of a statement that may be better left undefined so that the
larger context of the event can be taken into account in the event of
any dispute. For example what would a reasonable communications delay
be, say, between Europe and the USA in 1774? In 1984? In 2020? Well,
it depends on communications technology and that keeps changing. By
leaving it undefined in the corpus, the world of law gets to
interpret “reasonable” with respect to the bigger, “open world”
context of the world at the time of the incident.
In situations where
the world of law feels that some ambiguity should be removed, perhaps
as a result of cultural mores, scientific advances etc. it has the
medium of caselaw (if the judiciary is doing the interpretation
refinement), regulations/statutory instruments (if the executive
branch is doing the interpretation refinement) and primary law (if
the legislature/parliament) is doing the interpretation refinement.
One final point, we
have only just scratched the surface on the question of interpreting
meaning from the corpus of law here and indeed, there are very
different schools of thought on this matter within the field of
jurisprudence. A good starting point for those who would like to dig
deeper is textualism[16] and legislative intent[17].
In conclusion and attempting a humorous summary of this long post, the legal reasoning virtual box we imagined in part 1 of this series, is unavoidably
connected to it surroundings in the real world. Not just to detect,
say, the price of barrel of oil at time T, but also for concepts like
“price” and “barrel” and maybe even “oil”!
On the face of it,
the closed world of knowledge (CwoK) and the Unbounded Opinion
Requirement (UoR) might seem like very bad news for the virtual legal
reasoning box
However, I think the
opposite is actually true, for reasons I will explain in the nextpost in this series.
-->
Friday, April 07, 2017
What is law? - Part 7
Previously: What is law? - Part 6
Last time we ended
with the question : “Given
a corpus of law at time T, how can we determine what it all means?”
There is a real risk
of disappearing down a philosophical rabbit hole about how meaning is
encoded in the corpus of law. Now I really like that particular
rabbit hole but I propose that we not go down it here This whole area
is best perused, in my experience, with comfy chairs, time to kill
and a libation or two (semiotics, epistemolgy and mereotopology
anyone?).
Instead, we will
simply state that because the corpus of law is mostly written human
language it inherits some fascinating and deep issues to do with how
written text establishes shared meaning and move on. For our
purposes, we will imagine an infinitely patient person with infinite
stamina, armed with a normal adults grasp of English, who is going to
read the corpus and explain it back to us, so that we computer people
can turn it into something else inside a computer system. The goal of
that “something else” being to capture the meaning but be easier
to work with inside a computer than a big collection of
“unstructured” documents.
This little
conceptual trick of employing a fantastic human to read the current corpus and
explain it all back to us, allows us to split the problem of meaning
into two parts. The first part relates to how we could read it in
its current form and extract its meaning. The second part relates to
how we would encode the extracted meaning in something other than a
big collection of unstructured documents. Exploring this second question, will, I
believe, help us tease out the issues in determining meaning in the
corpus of law in general, without getting bogged down in trying to
get machines to understand the current format (lots and lots of unstructured documents!) right off
the bat.
I hope that makes
sense? Basically, we are going to skip over how we would parse it all
out of its current myriad document-form into a human brain and instead look at
how we would extract it from said brain and store it again – but
into something more useful than a big collection of documents.
Assuming we can find a representation that is good enough, the reading of the current corpus should
be a one-off exercise because as the corpus of law gets updated, we would update our bright shiny new digital representation of the corpus
and never have to re-process all the documents ever again.
So what options do
we have for this digital knowledge representation? Surely there is something better than just unstructured
document text? Text after all, is what you get if you use computers
as typewriters. Computers do also give us search, which is a
wonderful addition to typesetting, but understanding is a very
different thing again. In order to have machines understand the corpus of
law we need a way to represent the knowledge present in the law - not just what words are present (search) or how the words look on the page (formatting).
This is the point
where some of you are likely hoping/expecting that I am about to
suggest some wonderful combination of XML and Lisp or some such that
will fit the bill as a legal corpus knowledge representation
alternative to documents... It would be great if that were possible
but in my opinion, the textual/document-centric nature of a
significant part of the legal corpus is unavoidable for
reasons I will hopefully explain. Note that I said “significant
part”. There are absolutely components of the corpus that do not
have to be documents. In fact, some of the corpus has, already
transitioned out of documents but, if anything, this has actually
increased the interpretation complexities – of establishing meaning
- not reduced them. I will hopefully explain that too:-)
I think the best way
of explaining why I think some form of electronic documents is as
good as we can hope for, for large parts of the legal corpus, is to look at
the things that are not actually part of the corpus of documents at
all, but are key to how law actually works. It turns out that these
things cannot be put into a computer at all, in my opinion.
What are these
mystical things? There are two of them. The first I call the closed
world of knowledge (CWoK) and the second I call the Unbounded Opinion
Requirement (UOR) of law.
We will look at CwoK
and UOR in Part 8.
-->
Friday, March 31, 2017
What is law? - Part 6
Previously: What is law? - Part 5.
To wrap up our high level coverage of the sources of law we need to add a few items to the “big 3” (Statutes/Acts, Regulations/Statutory Instruments and Case law) covered so far.
To wrap up our high level coverage of the sources of law we need to add a few items to the “big 3” (Statutes/Acts, Regulations/Statutory Instruments and Case law) covered so far.
Many jurisdictions
have a foundational written document called a constitution which
essentially "bootstraps" a jurisdiction by setting out its
core principles, how its government is to be organized, how law will
be administered etc.
The core principles
expressed in constitutions are, in many respects, the exact opposite of
detailed rules/regulations. They tend to be
deontic[1] in nature,
that it, they express what ought to be true. They
tend
to be heavily open textured[2] meaning that they refer to
concepts that are necessarily
abstract/imprecise (e.g. concepts such
as "fairness", "freedom" etc.).
Although they only
make up a tiny tiny fraction of the corpus of law in terms of word
count, they are immensely
important, as essentially everything that
follows on from the constitution in terms of
Statutes/Acts,
Regulations/Statutory Instruments and case law has to be compatible
with the constitution.
Like everything else, the constitution can be
changed and thus all the usual "at time T" qualifiers apply
to constitutionality.
Next up is
international law such as international conventions/treaties which
cover everything
from aviation to cross-border criminal
investigation to intellectual property to doping in sport.
Next up, at local
community level residents of specific areas may have
rules/ordinances/bye-laws which are essentially Acts that apply to a
specific geographic area. There may be a compendium
of these, often
referred to as a "Municipal Code" in the case of cities.
I think that just
about wraps up the sources of law. It would be possible to fill many
blog posts with more variations on these (inter-state compacts,
federations/unions,
executive orders, private members bills etc.).
It would also be possible to fill many blog posts with how these all
overlap differently in different situations (e.g. what law applies
when there
are different jurisdictions involved in an
inter-jurisdictional contract.).
I don't think it would be
very
helpful to do that however. Even scratching the surface as we
have
done here will hopefully serve to adequately illustrate they
key point I would
like to make with is this: the corpus of law
applicable to any event E which
occurred at time T is a textually
complex, organizationally distributed, vast corpus of constantly
changing material. Moreover, there is
no central authority that manages it. It
is not necessarily
available as it was at time T - even if money is no object.
To wrap up, let us
summarize the potential access issues we have seen related to
accessing
the corpus of law at time T.
- Textual codification at time T might not be available (lack of codification, use of amendatory language in Acts. etc.)
- Practical access at time T may not be available (e.g. it is not practical to gather the paper versions of all court reports for all the caselaw, even if theoretically freely available.)
- Access rights at Time T may not be available (e.g. incorporated-by-reference rulebooks referenced in regulations)
All three access
issues can apply up and down the scale of location specificity from
municipal codes/bye-laws, regulations/statutory instruments,
Acts/Statutes, case law, union/federation law to international law
and, most recently, space law[3].
We are going to
glide serenely over the top of these access issues as the solutions
to them are not technical in nature. Next we turn to this key question:
Given a corpus of law at time T, how can we determine what it all means?
See you in Part 7.
Wednesday, March 29, 2017
What is law? - Part 5
Previously: What is law? - Part 4
The Judicial Branch
is where the laws and regulations created by the legislative and
executive branches make contact with the world at large. The most
common way to think of the judiciary is as the public forum where
sentences/fines for not abiding by the law are handed down and as the
public forum where disputes between private parties can be adjudicated by a neutral
third party. This is certainly a major part of it but it is also the
place where law gets clarified with finer and finer detail over time, in USA-style and UK-style "common law" legal systems.
I like to think of
the judicial
branch as being a boundary determinator for legal
matters. Any given incident e.g. a purported incident of illegal
parking, brings with it a set of circumstances unique to that
particular incident. Perhaps the circumstances in question are such
that the illegal parking charge gets thrown out, perhaps not. Think
of illegal parking as being – at the highest level – a straight
line, splitting a two dimensional plane into two parts. Circumstances
to the left of the line make the assertion of illegal parking true,
circumstances to the right of the line make the assertion false.
In the vast majority
of legal matters, the dividing line is not that simple. I think
of
the dividing line as a Koch Snowflake[1]. The separation between
legal and illegal
start out as a simple Euclidian boundary but over
time, the boundary becomes more and more complex as each new "probe"
of the boundary (a case before the courts), more detail to the
boundary is added.
Simple put, the law is a fractal[2]. Even if a
boundary starts out as a simple line segment separating true/false,
it can become more complex with every new case that comes to the
courts. Moreover, between any two sets of circumstances for a case A
and B, there are an infinity of circumstances that are in some sense,
in between A and B. Thus an infinity of new data points that can be
added between A and B over time.
Courts record their
judgments in documents known collectively as “case law”. The
most important thing about case law in our focus areas of USA-style
and UK-style legal systems is that it is actually law. It is not
just
a housekeeping exercise, recording the activity of the courts.
Each new piece of case law produced at time T, serves as an
interpretation of the legal corpus at time T. That corpus consists of
the Acts/Statutes in force, Regulations/Statutory Instruments in
force *and* all other caselaw in force at
time T. This is the legal
concept of precedent, also known as stare decesis[3].
The courts strive,
first and foremost, for consistency with precedents. A lot of weight
is attached to arriving at judgements in new cases
that are
consistent with the judgements in previous cases.
The importance of
this cannot be over-estimated in understanding law from a
computational
perspective. Where is the true meaning of law to be
found in common law jurisdictions? It is found in the case law! - not
the Acts or the regulations/Statutory Instruments.
If you are
reading an Act or a regulation and are wondering what it actually
means, the
place to go is the case law. The case law, in a very real
sense, is the place where
the actual meaning of law is spelled out.
From a linguistics
perspective you can think of this in terms of the pragmatics
counterpart to grammar/syntax. Wittgenstein fans can think of it as
“language is use”. i.e. the true meaning of language can be found
in how it is actually used in the real world. Logical Positivists
might think of it as a behaviorist approach to meaning. That is,
meaning comes from behavior. To understand what a law means – watch
what the courts interpret it to mean.
The meaning of the
law comes from how it is used in practice and that use comes from the
empirically observable behavior of the courts. I could be a staunch
advocate of my interpretation of the law at time T as written in the
Acts/Statutes and Regulations/SIs but if the caselaw supports a
different interpretation to mine, I will have an uphill battle
defending my interpretation in court.
There is a useful
computing analogy here too. Every programmer knows that there are
times when the quickest way to get to
the true meaning of a piece of
code is to run it and see what happens. In
the world of law, the
quickest way to get an understanding of the true meaning
of some
legislative material is to find how it has been treated in the case
law.
It is also a highly efficient way of getting to "truth"
because, at the end of the
day, it does not matter how many possible
interpretations might be valid for any
given point of law. What
really matters is how the courts have interpreted it in
the past.
Extending the
programming analogy a little bit. It is often easier
to figure out
what some code does in a particular set of circumstances by
looking
for a unit test that matches the circumstances of interest.
Extending
the analogy even further, any new tests added should not
invalidate the
existing tests and any code changes to acommodate new
circumstances should not invaldate any existing caselaw. In other
words caselaw behaves
a little like regression testing in software
development. The courts strive
to not "break" previous
judgements.
It will come as no
suprise that most lawyers place great importantance on caselaw
searching. It might come as a suprise that there is no central entity
that publishes
the official caselaw. Typically courts act
autonomously and publish their
own volumes of caselaw periodically.
Much of it, to this day, still on paper with
the paper being the
definitive source. I.e. if a court does produce paper plus
electronic
case law, the paper "wins" in the event of any
discrepency.
There is a long
history
going back to at least the Nineteenth century of third
parties acting as aggregators
of caselaw. Mostly notably, West
Publishing (now part of ThomsonReuters) and LexisNexis,
now part of
ReedElsevier. I think it is fair to say that the modern practice of
law in common law jurisdictions would not be possible if
practitioners did not have
the ability to rapidly search caselaw.
The sheer volume of
existing caselaw and the rate of creation of new caselaw is such
that without computers, the common law system would not be able to
function as it does today.
Most of the computational support to date
has been in the form of document production
and search/retrieval.
There are signs that that is changing now as machines start
to help
practitioners interpret the caselaw. This is a topic for another
day!.
It is important to
note that the corpus of caselaw is not purely accretive. Caselaw is,
from time-to-time, repealed and practitioners need to be careful in
citing caselaw to ensure that the cited caselaw is still considered
"good law". Again,
enter the computers and their search
capabilities. In particular a ubiquitous
legal term
"shepardizing"[4]
which refers to looking up a case to
find its status and find what other cases cite it and what other
cases it also cites.
The fact that
caselaw is not purely accretive creates yet another interesting “at
time T” issue. Any judgement the courts might arrive at, at time T
is necessarily contingent on the full corpus at time T. The exact
same issue, examined at some future time point T+1 might produce a
different result if some of the caselaw that was “good law” at
time T is no longer “good law” at time T+1. We will return to
this later on when we talk about defeasible logic and analogical
reasoning but they are best parked for now until we have finished the
survey of the sources of law itself.
It is in the area of
caselaw that our imagined virtual legal reasoning box runs
into its
biggest challenge with respect to access to the raw materials of
law.
In common law jurisdictions, the volume of caselaw that is
considered "good law"
at any time T is vast, goes back
centuries and is not available anywhere
as a single corpus.
Plus,
the best sources are in fee-based repositories.
The good news is
that the caselaw corpus is not homogenous in terms of its
importance
to precedent. In many interesting respects the caselaw corpus is
the
grand daddy of all Social Networks. Yes, you read that right. Social
Networks!
Cases are linked to other cases by means of a formal
referencing mechanism. A
commonly used set of standards for these
citations is known as the Blue Book[5].
The links between cases are
not randomly distributed. They are in fact a poster child for the
concept of a power law distribution[6].
Lawyers and judges
working with the caselaw corpus spend their time on the subset
of
cases that naturally follows from following citations. Cases that
that have high "rank" - where rank refers to the inbound
and outboud
connections to other cases – are very important cases, by virtue of the citation network around them. If this reminds you of
the original Google concept
of Page Rank you are exactly right.
Citations serve two primary purposes. Firstly,
they are indicative
of the relative importance of a case (“how often has this case been
cited positively in cases like mine?”) and secondly, they give
a
good indication of how robust a case is likely to be against repeal.
The
citation network can tell you a lot about the knock-on effect of
repeal and remember,
in common law systems, a really important
"logic" at work is the logic of consistency with previous
decisions.
There is an old
adage that it is not possible to step into the same river twice.
This adage capture my mental model of caselaw. It is like a fast
flowing river
with the added twist that over time, it can forge new
pathways and route around
obstacles, while continuing to be "the
same" river.
In fact, the entire corpus of law is like that.
It is constantly changing – every
day. Every new piece of caselaw,
every new regulation, every new act, adds new data points into the
fractal geometry of the previously mentioned Koch Snowflake of
legality.
Rivers are not easy
things to capture in databases! That is why, to my mind
, the key
challenge in regulatory data management is actually regulatory
change
management. In fact, I think of the two as being the
same thing.
Modelling the data is hard enough - as I hope you can
appreciate based on the
material presented here so far. Modelling
how the data changes and how any
computational system can be kept up
to date with the changes, is another matter completely. Regulatory
change is not something you can afford to park and
deal with another
day in any useful conceptual model of law. I would argue it
needs to
be the central plank of the data model of law. After all, if you have
a model
that works well when things change, it will work just fine
when things do not change.
But the reverse is not true.
So that is it for
caselaw for now.
Next up, we wrap up
coverage of the sources of law with some other sources not
yet
mentioned. We will also take a stab at summarising and classifying
the issues
related to accessing the corpus of law, covering all the
sources mentioned.
From there, we will
turn our attention to the legal reasoning process itself.
That is
where the fun stuff really starts. See What is Law - Part 6.
-->
Subscribe to:
Posts (Atom)