Bilos, R. and Fritzson, P. (1989). Experience from a Token Sequence Representation of Programs, Documents, and their Deltas. Technical Report LiTH-IDA-R-89-12, Department of Computer and Information Science, Linköping University, Sweden. Also presented at the International Workshop on Software Version and Configuration Control, Grassau, FRG, January 27-29, 1988. (bibtex),
Abstract: A primary goal with this work has been to investigate the consequences of a token-based program and document representation. This representation lies between plain text and trees in complexity.We have found that a program or a document represented as a token sequence saves on the average 50 representation. Another advantage is that deltas between program versions stored in source code control systems become insensitive to changes in whitespace or formatting style. Statistics from version-handling, computation of deltas, and storage is presented in the paper.
CS Dept TR Overview