# # Copyright (c) Members of the EGEE Collaboration. 2004. # See http://eu-egee.org/partners/ for details on the copyright holders. # For license conditions see the license file or http://eu-egee.org/license.html # # ChangeLog file for the GLite Data Transfer Agents module # # Authors: Paolo Badino # Version info: $Id: RELEASE-NOTES,v 1.64.2.7 2006/03/31 09:29:45 badino Exp $ # Release: $Name: glite-data-transfer-agents_R_2_2_2 $ # *** Release glite-data-transfer-agents_R_2_2_2-2 2006-03-31 o Add find-param xsl script to find a configuration parameter and display its properties *** Release glite-data-transfer-agents_R_2_2_2 2006-03-30 o Fix Bug #15874: FTS: Can't configure the http timeout in the ChannelAgent o Fix File reason when the retry strategy fails a file *** Release glite-data-transfer-agents_R_2_2_1_6 2006-03-13 o Assign default value o Pick up correct t-u-c status enum *** Release glite-data-transfer-agents_R_2_2_1_5 2006-03-09 o Added in YAIM support (XSLT). Pick up new yaim'd config service. *** Release glite-data-transfer-agents_R_2_2_1_4 2006-03-01 o Fix merge problem *** Release glite-data-transfer-agents_R_2_2_1_3 2006-02-27 o Fix mandatory attribute in channel-agent (urlcopy) templates *** Release glite-data-transfer-agents_R_2_2_1_2 2006-02-27 o CGSI_gSOAP library location has changed from ${repository}/${ext.cgsi-gsoap.subdir} to ${with.cgsi-gsoap.prefix} *** Release glite-data-transfer-agents_R_2_2_1 2006-01-30 o Block signals during execution of actions and use thread signals to stop the agent thread in order to try to avoid to problems in the oracle queries o Increase hard limit for TCP streams to 100 o Add expert configuration paremeters: - transfer-agent-scheduler.StopTimeout - transfer-agent-dao-oracle.Threaded *** Release glite-data-transfer-agents_R_2_2_0 2005-11-24 o Upgrade to FTS Queue Schema v. 2.2.0: new properties are - File finishTime: store the time when the file finished/failed - File currentFailures: number of failures during current iterations. This value is reset when the FTA move a File from HOLD to PENDING - Job submitHost: the hostname of the FTS that received the transfer request - Job maxTimeInQueue: (Not yet implemented) number of seconds a job can stay in queue o Move Retry Action to use Strategy Pattern o Allow to override Basic Retry Strategy with a python script o Refactor Unit Tests o Refactor config o Refactor dependencies to use libtool .la files o Fix Bug: * 13724 FTS: Inconsistent jobs' states in FTA * 13301 FTS: FTA doesn't respect the transfer limit imposed in the channel table * 12961 FTS: FTA uses the wrong service type for GridFTP services * 13838 FTS: typos in agent channel log file o Workaround for Bug: * 13310 FTS: memory leak in daemons Probably due to a memory leak in utils-c o Drop Custom Actions from the VO Agents, since it wasn't clear how to use them o Set the default Retry Interval for the VO Agent to 60 seconds instead of using the value proivided by the DefaultInterval property (3 seconds) o Don't try to normalize the TURLs o Add a smarter RetryStrategy as a python script o Add python UnitTests for Retry Strategies o Fix typo in channel-agent configuration parameter VOShareType: values should be normalized and normalized-on-active, not nomalized (Expert parameter, shouldn't affetct the deployment modules) *** Release glite-data-transfer-agents_R_2_1_0 2005-10-18 o Merge back changes from 1.4 branch: * Export modules configuration templates * Add configuration schema version in the generated service config templates * Fix Bugs #10440: FTS: ChannelAgent doesn't always use client delegated credentials for srmcopy #10329 FTS: FTA doesn't retry transfers when urlcopy doesn't return a reason class #10490: FTA channel agent with MySQL backend don't start #10498: FTS: missing MySQL port FTA configuration parameter #10534: FTA MySQL: agents get the wrong type #10720: FTS: FTA. SRM copy: not all requests are filled with duration #10076: FTS: should return error immediately if host is not SRM #10823: FTS: FPS doesn't contact the catalog with the user delegated credentials and then dies #10633: FTS: myproxy should be an "associated service" for a FTS #11065: FTS: Sometimes t_transfer reports a file as Active while the job (and file) are in Hold #11221: FTS: inefficient query on agent can stop transfers * Improve SD for VO support * Fix SRMCopy Transfer status in case of error * Add myproxy error into the file reason when job fail to get delegated credentials * Fix Myproxy certificate caching * Improve vo share query in the Oracle Connector (using analytics) * Clear MyProxy Error Message o Normalize SURLs o Cache SD information: - Add transfer-agent-sd.EnableCache expert configuration option to enable/disable the SD Cache (default = true) - Add transfer-vo-agent.CleanSDCache_Interval expert configuration option to clean periodically the cache in the VO Agent (default = 3600) - Add transfer-channel-agent.CleanSDCache_Interval expert configuration option to clean periodically the cache in the Channel Agent (default = 3600) o Refactor a bit glite/data/transfers/agent/module/*.h in order to make the export simpler (this would be required by future versions) *** Release glite-data-transfer-agents_R_2_0_1r21 2005-10-05 * Normalize SURLs *** Release glite-data-transfer-agents_R_2_0_11 2005-09-29 * Fix Bug #11221: FTS: inefficient query on agent can stop transfers * Clear MyProxy Error Message *** Release glite-data-transfer-agents_R_2_0_10 2005-09-27 * Fix Bug #11065: FTS: Sometimes t_transfer reports a file as Active while the job (and file) are in Hold *** Release glite-data-transfer-agents_R_2_0_9 2005-09-26 * Fix Bug #10633: FTS: myproxy should be an "associated service" for a FTS *** Release glite-data-transfer-agents_R_2_0_8 2005-09-20 * Improve vo share query in the Oracle Connector (using analytics) *** Release glite-data-transfer-agents_R_2_0_7 2005-09-15 * Fix Bug #10823: FTS: FPS doesn't contact the catalog with the user delegated credentials and then dies * Fix Myproxy certificate caching *** Release glite-data-transfer-agents_R_2_0_6 2005-09-12 * Fix Bug #10076: FTS: should return error immediately if host is not SRM * Add myproxy error into the file reason when job fail to get delegated credentials *** Release glite-data-transfer-agents_R_2_0_5 2005-09-12 * Fix Bug #10720: FTS: FTA. SRM copy: not all requests are filled with duration *** Release glite-data-transfer-agents_R_2_0_4_2 2005-08-31 * Fix Bug #10557: FTS: transfers with SRM copy fail *** Release glite-data-transfer-agents_R_2_0_4_1 2005-08-30 * Fix Bug #10534: FTA MySQL: agents get the wrong type *** Release glite-data-transfer-agents_R_2_0_3_2 2005-08-29 * Improve VO Support for ServiceDiscovery *** Release glite-data-transfer-agents_R_2_0_3 2005-08-26 * Export modules configuration templates * Add configuration schema version in the generated service config templates * Fix Bugs #10490: FTA channel agent with MySQL backend don't start #10498: FTS: missing MySQL port FTA configuration parameter *** Release glite-data-transfer-agents_R_2_0_2_4 2005-08-23 * Fix Bug #10440: FTS: ChannelAgent doesn't always use client delegated credentials for srmcopy *** Release glite-data-transfer-agents_R_2_0_2_3 2005-08-19 * Fix Bug #10329 FTS: FTA doesn't retry transfers when urlcopy doesn't return a reason class *** Release glite-data-transfer-agents_R_2_0_2_2 2005-08-15 * simplified config with examples *** Release glite-data-transfer-agents_R_2.0.1_2 2005-08-15 * Fail to start a channel agent if the related channel doesn't exist * Add version number to the libraries *** Release glite-data-transfer-agents_R_2.0.1 2005-08-05 * Refactor SrmCopy support (implies some configuration changes) * Add heartbeat action in order to set the agent state into the t_agent table * During starting phase, check if there's no agent running for the same VO or Channel * Update config templates to use the latest config_generator schema (1.1.10) *** Release glite-data-transfer-agents_R_2.0.0_5 2005-07-29 * Fix default value for vo-agent.DisableDelegationForTransfers Configuration Template parameter *** Release glite-data-transfer-agents_R_2.0.0_4 2005-07-28 * Fix Job fetching by Priority *** Release glite-data-transfer-agents_R_2.0.0_3 2005-07-27 * Improve handling of VO share: now the channel agent can be configured to handle the VO share differently (absolute, normalized, normalized on VO with active jobs) * Workaround for bug #9712 FTS: when myproxy retrieval fails, the DB connection sometimes drops * some changes on the CatalogService in order to allow to return the list of file names that failed in the bulk operation (improve error reporting on the database) *** Release glite-data-transfer-agents_R_2.0.0_2 2005-07-19 * Fix Defects #9549 FTS: actually use the number of streams per channel setting #9531 FTS: 'reason' buffer is only 1024 bytes, and if overfilled results in Oracle error on update #9338 FTS: agent should fill in DN field when it updates a table #8379 FTS: MyProxy version is not compatible with the VDT version on LCG-2 #8374 FTS: Usage of SRM Copy *** Release glite-data-transfer-agents_R_2.0.0 2005-07-06 * Architecture Refactoring: now the FTA is logically splitted in two agents the Channel Agent and the VO Agent, in order to allow proper inter-VO scheduling. This change also affects the configuration (have a look at the configuration template for the possible deployment scenarios) * Fix Defects #8366 FTS: Transfer Agent for a channel is per-VO #8386 FTS: No inter-VO scheduling #7503 FTS: Add TURL:TURL to DB * Move to ServiceDiscovery v 2.0.0 * Export include files in order provide some extensibility with user defined actions *** Release glite-data-transfer-agents_R_1_9_1 2005-05-30 * Fix Defect #8783 'FTS: agents EnableHold property is not read correctly' * Add configuration Parameter transfer-vo.DeploymentType in order to differentiate the Job FSM behavior depending on the deployment scenario (see bug #8787 'FTS: FTS alone should not transition to FinishedDirty') *** Release glite-data-transfer-agents_R_1_9_0 2005-05-12 * [FTS/FPS] Update documentation and configuration scripts * Fix Oracle DAO Connector (no logical name retrieved for the FileTransfer instance) and update related TestCase * Some small bug fixes after FPS functional tests * Use user credentials for file name resolution and replica registration (unsetting X509_USER_CERT/KEY env. vars appropriately) *** Release glite-data-transfer-agents_R_1_8_1 2005-04-26 * [FTS/FPS] update documentation (no crontab usage any more, see 1.8.0-5) * [FPS] Add UnitTest for RegisterReplica Action and fix some small bugs. *** Release glite-data-transfer-agents_R_1_8_0_5 2005-04-19 * crontab config is no longer supported; FPS and FTS configs are separate * fix for R1.1: still using v2.0.0 of catalog-interface * fix SURL handling typo * added MyProxy-1.14-EGEE dependency *** Release glite-data-transfer-agent_R_1_8_0 2005-04-15 10:00 badino * Implement Catalog Name Resolution and replica Registration *** Release glite-data-transfer-agent_R_1_7_0 2005-03-24 14:33 badino * Implement Waiting and Retry (Requirement 1.2, Bug #7506) * Pass paramters to the transfer (Bug #7508) *** Release glite-data-transfer-agent_R_1_6_5 2005-03-21 09:14 badino * Fix a problem in checking proxy validity * Refactor Oracle DAO to introduce Smart pointers for Connection, Statement and ResultSet instances *** Release glite-data-transfer-agent_R_1_6_4 2005-03-18 13:44 badino * Use globus API to check proxy validity * Implement myproxy as a plug-in and remove compile time dependency in transfer-actions *** Release glite-data-transfer-agent_R_1_6_3 2005-03-17 12:01 badino * Fix bug #7184: Review Logs' Priority * Add monitoring information: Transfer Time, Duration, File Size and Bytes Written * Add a configuration parameter to defined the time a scheduled action stays in the disable state *** Release glite-data-transfer-agent_R_1_6_2 2005-03-14 17:17 badino * Fix bug #7361: Periodically check if the connection is alive and reconnect if needed * Remove exception specifications from method declarations (according to Herb Sutter's "C++ Coding Standards", they are useless and may introduce additional run-time overhead) *** Release glite-data-transfer-agent_R_1_6_1 2005-03-11 14:12 badino * Fix bug #7358: SURL with hostname not specifying a port number are now correctly handled. *** Release glite-data-transfer-agent_R_1_6_0 2005-03-09 11:27 badino * Review the logic for FileDAO::getNextToTransfer to return the list of file ids grouped by job id * Retrive proxy Certificate from MyProxy Server * Use proxy Certificate to perform the File Transfer *** Release glite-data-transfer-agent_R_1_5_0 2005-03-03 16:20 badino * Implement Channel Allocation using the "Allocate" Action * Review the logic to Fetch the transfer in order to comply with the channel state *** Release glite-data-transfer-agent_R_1_4_0 2005-02-25 16:41 badino * Add Oracle DAO Connector *** Release glite-data-transfer-agent_R_1_3_2 2005-02-21 17:40 badino * Fix a actions Memory Leak *** Release glite-data-transfer-agent_R_1_3_1 2005-02-18 15:38 badino * Some internal refactoring on the DAO classes *** Release glite-data-transfer-agent_R_1_3_0 2005-02-15 20:00 badino * Provides a Transfer Action Scheduler that could be installed as a deamon to get rid of cron (glite-data-transfer-agent application is now deprecated) * Check Schema Version on the MySQL DAO Connector * Escape strings in MySQL DAO Connector to prevent SQL Injection *** Release glite-data-transfer-agent_R_1_2_0 2005-02-11 18:06 badino * Implement the Cancel action, in order to revoke active file Transfer * Refactor to move logic into FSM * Lock always rows before updating *** Release glite-data-transfer-agent_R_1_1_1 2005-02-03 16:06 badino * Rename glite_data_transfer_agent in glite-data-transfer-agent (Backward compatibility is preseved using symlinks, but is deprecated) * update documentation *** Release glite-data-transfer-agent_R_1_1_0 2005-02-01 15:00 badino * Refactor Transfer Agent. * Add connector for GLite UrlCopy *** Release glite-data-transfer-agent_R_1_0_0 2004-12-09 17:41 badino * First Release *** Release glite-data-transfer-fts_R_0_0_0 2004-12-03 00:00 badino * Stub implementation