CampusFactory at NCSA Lincoln

I recently set up CampusFactory on NCSA Lincoln to flock jobs from the new Engage submit node.

The CampusFactory is a Condor job submitted to a personal condor instance. The job executes the Factory which is implemented as a Python script.

  • The factory queries remote Condor schedds for idle jobs.
  • It uses glite to launch glideins on Lincoln compute nodes.
  • The glideins join the schedd pool of the campus factory Condor instance.
  • Jobs flock from the submit node to the CampusFactory glideins and execute.
  • Results are transferred back to the submit node.

Jobs must be submitted in the vanilla universe so this is not a viable way to offload already submitted grid universe jobs.

This entry was posted in Uncategorized. Bookmark the permalink.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s