Audit master archiving and compression

Last post 03-27-2012 12:21 PM by Jay.Clark. 5 replies.
Page 1 of 1 (6 items)
Sort Posts: Previous Next
  • 03-22-2012 10:30 AM

    Audit master archiving and compression

    Hi,

    I use the Auditmaster 8. And I set the archiving policy to archive auditlogs with 200MB treshold.

    I see the following in documentations:

    "ID: 00016627 - Is any maintenance required for AuditMaster logs and archives?
    Description:   
    Environment:    AuditMaster 6.0 Pervasive.SQL V8 Service Pack 1 Known Issue
    Cause:   
    Solution:    Every database operation configured to be audited will result in at least one audit log entry, and some will have multiple entries. In order to reduce audit log disk space requirements, AuditMaster has a feature enabling the audit log to be automatically compressed and archived. To set the size at which this automatic compression is activated, open the AuditMaster Viewer, then select Admin>Server Settings>AMMON SETTINGS. The Archive Threshold setting determines the log size at which AuditMaster will begin automatically compressing and archiving the audit log. NOTE: By default, all of these audit logs and archives are written and stored on the same disk drive on which AuditMaster was installed. You must periodically check your disk for available space and back up and remove old archives. If your disk becomes full, AuditMaster will write an error to your status log, and all auditing will stop until you clear disk space, then stop and restart your database services. It is critical that you perform this maintenance activity regularly.
    Published:    October 2003"


    The previous arcticle write the following statement:
    „The Archive Threshold setting determines the log size at which AuditMaster will begin automatically compressing and archiving the audit log”

    This statement is not true. The archiving and copmressing process sometime are executed in different time:

    Status 2012/03/21 14:20:05 ammsgapi.c 7680 AMMON 0 Start Quick Archiving : 20120321.09
    Status 2012/03/21 14:20:18 ammsgapi.c 7680 AMMON 0 Finished Quick Archiving : 20120321.09
    Status 2012/03/21 14:20:18 ammsgapi.c 7680 AMMON 0 Start compressing file : 20120321.05
    Status 2012/03/21 14:20:23 ammsgapi.c 7680 AMMON 0 Finished compressing : 20120321.05
    Status 2012/03/21 15:11:43 ammsgapi.c 7680 AMMON 0 Start Quick Archiving : 20120321.0a
    Status 2012/03/21 15:11:56 ammsgapi.c 7680 AMMON 0 Finished Quick Archiving : 20120321.0a
    Status 2012/03/21 15:11:56 ammsgapi.c 7680 AMMON 0 Start compressing file : 20120321.06
    Status 2012/03/21 15:12:02 ammsgapi.c 7680 AMMON 0 Finished compressing : 20120321.06
    Status 2012/03/21 23:58:54 ammsgapi.c 7680 AMMON 0 Start compressing file : 20120321.0A
    Status 2012/03/21 23:59:01 ammsgapi.c 7680 AMMON 0 Finished compressing : 20120321.0A
    Status 2012/03/21 23:59:01 ammsgapi.c 7680 AMMON 0 Start compressing file : 20120321.09
    Status 2012/03/21 23:59:07 ammsgapi.c 7680 AMMON 0 Finished compressing : 20120321.09
    Status 2012/03/21 23:59:07 ammsgapi.c 7680 AMMON 0 Start compressing file : 20120321.08
    Status 2012/03/21 23:59:14 ammsgapi.c 7680 AMMON 0 Finished compressing : 20120321.08
    Status 2012/03/21 23:59:14 ammsgapi.c 7680 AMMON 0 Start compressing file : 20120321.07
    Status 2012/03/21 23:59:20 ammsgapi.c 7680 AMMON 0 Finished compressing : 20120321.07
    Status 2012/03/21 23:59:20 ammsgapi.c 7680 AMMON 0 Start Quick Archiving : 20120321.0B
    Status 2012/03/21 23:59:33 ammsgapi.c 7680 AMMON 0 Finished Quick Archiving : 20120321.0B
    Status 2012/03/21 23:59:33 ammsgapi.c 7680 AMMON 0 Start compressing file : 20120321.0B
    Status 2012/03/21 23:59:37 ammsgapi.c 7680 AMMON 0 Finished compressing : 20120321.0B
    Status 2012/03/22 09:54:13 ammsgapi.c 7680 AMMON 0 Start Quick Archiving : 20120322.00
    Status 2012/03/22 09:54:26 ammsgapi.c 7680 AMMON 0 Finished Quick Archiving : 20120322.00
    Status 2012/03/22 10:06:13 ammsgapi.c 7680 AMMON 0 Start Quick Archiving : 20120322.01
    Status 2012/03/22 10:06:25 ammsgapi.c 7680 AMMON 0 Finished Quick Archiving : 20120322.01
    Status 2012/03/22 15:19:57 ammsgapi.c 7680 AMMON 0 Start Quick Archiving : 20120322.02
    Status 2012/03/22 15:20:09 ammsgapi.c 7680 AMMON 0 Finished Quick Archiving : 20120322.02

    My question is:
    When started the compression process? Randomly?
    How can I control it?

    Regards,
    Gyuri

  • 03-22-2012 12:29 PM In reply to

    Re: Audit master archiving and compression

     In Audit Master v8 the configuration for Automatic Archiving is located in Admin>Server Settings>Automated Arching.  You can set archiving to be "By Date and Time" or "By Size Threshold".  How did you set this?  If you set it by size then the archiving will happen when the log reaches a certain size.  The timing on this could vary by what is being audited.  If you set it by Date and Time then the archiving should happen at the times you set.

  • 03-23-2012 5:07 AM In reply to

    Re: Audit master archiving and compression

    Hi, I set the "By Size Threshold" to 200MB. "If you set it by size then the archiving will happen when the log reaches a certain size. The timing on this could vary by what is being audited." I understand the timing of archiving, but I don't understand timing of compression! How can I configure the compression timing? Regards, Gyuri
  • 03-23-2012 10:30 AM In reply to

    Re: Audit master archiving and compression

    My apologies, I did not catch the compression question.  We only have settings for Archiving.  There is no way that I know of to set a time/size for compression.  AM has the ability to Archive, Compress, and Archive & Compress.  I broke down the log entries you provided and put what I think happened.  In my test environment here I only get compression when I manually ask for compression.

      Normal 0 false false false EN-US X-NONE X-NONE MicrosoftInternetExplorer4 /* Style Definitions */ table.MsoNormalTable {mso-style-name:"Table Normal"; mso-tstyle-rowband-size:0; mso-tstyle-colband-size:0; mso-style-noshow:yes; mso-style-priority:99; mso-style-qformat:yes; mso-style-parent:""; mso-padding-alt:0in 5.4pt 0in 5.4pt; mso-para-margin:0in; mso-para-margin-bottom:.0001pt; mso-pagination:widow-orphan; font-size:11.0pt; font-family:"Calibri","sans-serif"; mso-ascii-font-family:Calibri; mso-ascii-theme-font:minor-latin; mso-fareast-font-family:Calibri; mso-fareast-theme-font:minor-latin; mso-hansi-font-family:Calibri; mso-hansi-theme-font:minor-latin; mso-bidi-font-family:"Times New Roman"; mso-bidi-theme-font:minor-bidi;}

    Status 2012/03/21 14:20:05 ammsgapi.c 7680 AMMON 0 Start Quick Archiving : 20120321.09

    Status 2012/03/21 14:20:18 ammsgapi.c 7680 AMMON 0 Finished Quick Archiving : 20120321.09

    Status 2012/03/21 14:20:18 ammsgapi.c 7680 AMMON 0 Start compressing file : 20120321.05

    Status 2012/03/21 14:20:23 ammsgapi.c 7680 AMMON 0 Finished compressing : 20120321.05

                    -- Archive & Compress run manually

     

    Status 2012/03/21 15:11:43 ammsgapi.c 7680 AMMON 0 Start Quick Archiving : 20120321.0a

    Status 2012/03/21 15:11:56 ammsgapi.c 7680 AMMON 0 Finished Quick Archiving : 20120321.0a

    Status 2012/03/21 15:11:56 ammsgapi.c 7680 AMMON 0 Start compressing file : 20120321.06

    Status 2012/03/21 15:12:02 ammsgapi.c 7680 AMMON 0 Finished compressing : 20120321.06

                    -- Archive and Compress run manually

     

    Status 2012/03/21 23:58:54 ammsgapi.c 7680 AMMON 0 Start compressing file : 20120321.0A

    Status 2012/03/21 23:59:01 ammsgapi.c 7680 AMMON 0 Finished compressing : 20120321.0A

                    -- Compress run manually

     

    Status 2012/03/21 23:59:01 ammsgapi.c 7680 AMMON 0 Start compressing file : 20120321.09

    Status 2012/03/21 23:59:07 ammsgapi.c 7680 AMMON 0 Finished compressing : 20120321.09

                    -- Compress run manually

     

    Status 2012/03/21 23:59:07 ammsgapi.c 7680 AMMON 0 Start compressing file : 20120321.08

    Status 2012/03/21 23:59:14 ammsgapi.c 7680 AMMON 0 Finished compressing : 20120321.08

                    -- Compress run manually

     

    Status 2012/03/21 23:59:14 ammsgapi.c 7680 AMMON 0 Start compressing file : 20120321.07

    Status 2012/03/21 23:59:20 ammsgapi.c 7680 AMMON 0 Finished compressing : 20120321.07

                    -- Compress run manually

     

    Status 2012/03/21 23:59:20 ammsgapi.c 7680 AMMON 0 Start Quick Archiving : 20120321.0B

    Status 2012/03/21 23:59:33 ammsgapi.c 7680 AMMON 0 Finished Quick Archiving : 20120321.0B

    Status 2012/03/21 23:59:33 ammsgapi.c 7680 AMMON 0 Start compressing file : 20120321.0B

    Status 2012/03/21 23:59:37 ammsgapi.c 7680 AMMON 0 Finished compressing : 20120321.0B

                    -- Archive & Compress run manually

     

    Status 2012/03/22 09:54:13 ammsgapi.c 7680 AMMON 0 Start Quick Archiving : 20120322.00

    Status 2012/03/22 09:54:26 ammsgapi.c 7680 AMMON 0 Finished Quick Archiving : 20120322.00

                    -- Archive (Scheduled?)

     

    Status 2012/03/22 10:06:13 ammsgapi.c 7680 AMMON 0 Start Quick Archiving : 20120322.01

    Status 2012/03/22 10:06:25 ammsgapi.c 7680 AMMON 0 Finished Quick Archiving : 20120322.01

                    -- Archive (Scheduled?)

     

    Status 2012/03/22 15:19:57 ammsgapi.c 7680 AMMON 0 Start Quick Archiving : 20120322.02

    Status 2012/03/22 15:20:09 ammsgapi.c 7680 AMMON 0 Finished Quick Archiving : 20120322.02

                    -- Archive (Scheduled?)

     

  • 03-27-2012 1:47 AM In reply to

    Re: Audit master archiving and compression

    Hi,

    I didn't execute compress manually. So I don't know why compressed the following entries:

    Status 2012/03/21 23:58:54 ammsgapi.c 7680 AMMON 0 Start compressing file : 20120321.0A
    Status 2012/03/21 23:59:01 ammsgapi.c 7680 AMMON 0 Finished compressing : 20120321.0A
                    -- Compress run manually
     
    Status 2012/03/21 23:59:01 ammsgapi.c 7680 AMMON 0 Start compressing file : 20120321.09
    Status 2012/03/21 23:59:07 ammsgapi.c 7680 AMMON 0 Finished compressing : 20120321.09
                    -- Compress run manually
     
    Status 2012/03/21 23:59:07 ammsgapi.c 7680 AMMON 0 Start compressing file : 20120321.08
    Status 2012/03/21 23:59:14 ammsgapi.c 7680 AMMON 0 Finished compressing : 20120321.08
                    -- Compress run manually
     
    Status 2012/03/21 23:59:14 ammsgapi.c 7680 AMMON 0 Start compressing file : 20120321.07
    Status 2012/03/21 23:59:20 ammsgapi.c 7680 AMMON 0 Finished compressing : 20120321.07
                    -- Compress run manually

    This is a mysterious event for me ...

    Regads,
    Gyuri

  • 03-27-2012 12:21 PM In reply to

    Re: Audit master archiving and compression

     I might be able to shed some light on this now.  It appears that there may be a threshold for compression.  Running a couple of tests I did see compression happen automatically without asking for it.

    With an Archive Limit  of 40Mb I saw compression after 21 archives.  With the default Archive limit of 75 it happened around 12 archives. The math works out to about 900Mb in total space of archives. 

    So at this point I think that somewhere in the code there is a call for compression if the archives reach a certain size total.

     

Page 1 of 1 (6 items)