Databases Reference
In-Depth Information
Message batching
It is common for an incoming file to contain many records.
These records, when processed, can impact system performance
and memory requirements. Hence it is important to align the
use of the records with their likely impact on system resources.
Detecting that the file is available
The next step in the wizard allows us to configure the frequency of polling for the
inbound file. There are two parameters that can be configured here-the
Polling
Frequency
and the
Minimum File Age
.
The
Polling Frequency
just means the time delay between checking to see if a file
is available for processing. The adapter will check once per interval to see if the
file exists. Setting this too low can consume needless CPU resources, setting it too
high can make the system appear unresponsive. 'Too high' and 'too low' are very
subjective and will depend on your individual requirements. For example, the
polling interval for a file that is expected to be written twice a day may be set to three
hours, while the interval for a file that is expected to be written every hour may be
set to 15 minutes.
Minimum File Age
specifies how old a file must be before it is processed by the
adapter. This setting allows a file to be completely written before it is read. For
example, a large file may take five minutes to write out from the original application.
If the file is read three minutes after it has been created, then it is possible for the
adapter to run out of records to read and assume the file has been processed, when
in reality, the application is still writing to the file. Setting a minimum age to ten
minutes would avoid this problem by giving the application at least ten minutes to
write the file.
