Skip to main content
U.S. flag

An official website of the United States government

Jonathan M Knudson (Former Employee)

Science and Products

USGS science for a changing world logo

Flocks of a feather dock together: Using Docker and HTCondor to link high-throughput computing across the USGS

USGS scientists often face computationally intensive tasks that require high-throughput computing capabilities. Several USGS facilities use HTCondor to run their computational pools but are not necessarily connected to the larger USGS pool. This project demonstrated how to connect HTCondor pools by flocking, or coordinating, within the USGS. In addition to flocking the Upper Midwest...
By
Community for Data Integration (CDI)
Flocks of a feather dock together: Using Docker and HTCondor to link high-throughput computing across the USGS

Flocks of a feather dock together: Using Docker and HTCondor to link high-throughput computing across the USGS

USGS scientists often face computationally intensive tasks that require high-throughput computing capabilities. Several USGS facilities use HTCondor to run their computational pools but are not necessarily connected to the larger USGS pool. This project demonstrated how to connect HTCondor pools by flocking, or coordinating, within the USGS. In addition to flocking the Upper Midwest Environmental
Learn More
USGS science for a changing world logo

Hunting Invasive Species with HTCondor: High Throughput Computing for Big Data and Next Generation Sequencing

Large amounts of data are being generated that require hours, days, or even weeks to analyze using traditional computing resources. Innovative solutions must be implemented to analyze the data in a reasonable timeframe. The program HTCondor (https://research.cs.wisc.edu/htcondor/) takes advantage of the processing capacity of individual desktop computers and dedicated computing resources...
By
Community for Data Integration (CDI)
Hunting Invasive Species with HTCondor: High Throughput Computing for Big Data and Next Generation Sequencing

Hunting Invasive Species with HTCondor: High Throughput Computing for Big Data and Next Generation Sequencing

Large amounts of data are being generated that require hours, days, or even weeks to analyze using traditional computing resources. Innovative solutions must be implemented to analyze the data in a reasonable timeframe. The program HTCondor (https://research.cs.wisc.edu/htcondor/) takes advantage of the processing capacity of individual desktop computers and dedicated computing resources as a
Learn More

Science and Products

USGS science for a changing world logo

Flocks of a feather dock together: Using Docker and HTCondor to link high-throughput computing across the USGS

USGS scientists often face computationally intensive tasks that require high-throughput computing capabilities. Several USGS facilities use HTCondor to run their computational pools but are not necessarily connected to the larger USGS pool. This project demonstrated how to connect HTCondor pools by flocking, or coordinating, within the USGS. In addition to flocking the Upper Midwest...
By
Community for Data Integration (CDI)
Flocks of a feather dock together: Using Docker and HTCondor to link high-throughput computing across the USGS

Flocks of a feather dock together: Using Docker and HTCondor to link high-throughput computing across the USGS

USGS scientists often face computationally intensive tasks that require high-throughput computing capabilities. Several USGS facilities use HTCondor to run their computational pools but are not necessarily connected to the larger USGS pool. This project demonstrated how to connect HTCondor pools by flocking, or coordinating, within the USGS. In addition to flocking the Upper Midwest Environmental
Learn More
USGS science for a changing world logo

Hunting Invasive Species with HTCondor: High Throughput Computing for Big Data and Next Generation Sequencing

Large amounts of data are being generated that require hours, days, or even weeks to analyze using traditional computing resources. Innovative solutions must be implemented to analyze the data in a reasonable timeframe. The program HTCondor (https://research.cs.wisc.edu/htcondor/) takes advantage of the processing capacity of individual desktop computers and dedicated computing resources...
By
Community for Data Integration (CDI)
Hunting Invasive Species with HTCondor: High Throughput Computing for Big Data and Next Generation Sequencing

Hunting Invasive Species with HTCondor: High Throughput Computing for Big Data and Next Generation Sequencing

Large amounts of data are being generated that require hours, days, or even weeks to analyze using traditional computing resources. Innovative solutions must be implemented to analyze the data in a reasonable timeframe. The program HTCondor (https://research.cs.wisc.edu/htcondor/) takes advantage of the processing capacity of individual desktop computers and dedicated computing resources as a
Learn More
Was this page helpful?