Infrastructure for Building Code Search Applications for Developers - Finding Source Code on the Web for Remix and Reuse - page 140

Project metadata: The project.properties file is a generic project description
format that generalizes the project metadata from the online repositories. Many at-
tributes in project.properties are optional, except for the following:

•

crawledDate : indicates when the crawler picked up the project information

•

originRepositoryUrl :

URL of the originating repository; e.g., http://

sourceforge.net
• name : project's name as given in the originating repository
• containerUrl : project's unique URL in the originating repository

And, one or both of the following: (i) Information on project's SCM system in-
dicated by scmUrl (ii) Information on project's source package distributed on the
originating repository, as indicated by the following fields:

•

package.size indicating total number of packages distributed.

• indicating name of the i th package, where 1 < = i < =

package.name. i

package . size ,and i indicates a unique integer denoting a package number.

•

package.sourceUrl. i indicating the URL to get the i th package from the orig-
inating repository.

The example below shows metadata description for a project crawled from
Google code hosting.

00 #Thu Sep 24 16:15:01 PDT 2009
01 releaseDate=null
02 name=dlctarea1
03 category=DLC, Java, Netbeans, FileChooser
04 languageGuessed=Java
05 versionGuessed=$SCM
06 scmUrl=svn checkout
http\://dlctarea1.googlecode.com/svn/trunk/
dlctarea1-read-only
07 license=GNU General Public License v2
08 keywords=null
09 sourceUrl=null
10 exractedVersion=$SCM
11 projectDescription=Tarea n\uFFFD 1
12 fileExtensions=null
13 originRepositoryUrl=http\://code.google.com
14 containerUrl=http\://code.google.com/p/dlctarea1/
15 contentDescription=null
16 crawledDate=2009-Sep-23

Jar Storage: In addition to the top-level batch directories described above, the
local repository also contains a single jars directory. The jars directory is structured
as follows:

<repo_root>/jars/project/<jar_path>
<repo_root>/jars/maven/<jar_path>
<repo_root>/jars/index.txt

The project subdirectory contains all of the jar files that come packaged with
the projects in the main repository. This directory is populated by crawling through
the repository itself, and copying every jar found. The copying is done so that
these jar files can be modified, if necessary, without altering the original projects.