Oops - meant to say "the deletions all failed" - not expirations. Now I get to try them, again.....
On Tue, Feb 26, 2019 at 8:17 AM Zoltan Forray <zfor...@vcu.edu> wrote: > Thanks for the confirmation that I am not the only one seeing it and > wondering what is going on. FWIW, the expirations all failed/crashed with > strange "unexpected error 4522 fetching row in table "Backup.Objects" (or > Filespaces). The last "q proc" I recorded: > > 2,325 DELETE FILESPACE Deleting file space > ORION-POLL-W2\SystemState\NULL\System State\SystemState (fsId=1) (backup > data) for node ORION-POLL-W2: 119,442,593 objects deleted. > > 2,326 DELETE FILESPACE Deleting file space > ORION-POLL-E2\SystemState\NULL\System State\SystemState (fsId=1) (backup > data) for node ORION-POLL-E2: 116,621,727 objects deleted. > > > Then I see this in the logs: > > 2/25/2019 3:07:29 PM ANR1893E Process 2324 for DELETE FILESPACE completed > with a completion state of FAILURE. > 2/25/2019 3:32:53 PM ANR0106E imfs.c(8340): Unexpected error 4522 fetching > row in table "Filespaces". > 2/25/2019 3:32:53 PM ANR0106E imfsdel.c(2723): Unexpected error 4522 > fetching row in table "Backup.Objects". > 2/25/2019 3:32:53 PM ANR1893E Process 2325 for DELETE FILESPACE completed > with a completion state of FAILURE. > 2/25/2019 4:29:26 PM ANR0106E imfsdel.c(2723): Unexpected error 4522 > fetching row in table "Backup.Objects". > 2/25/2019 4:29:26 PM ANR1893E Process 2326 for DELETE FILESPACE completed > with a completion state of FAILURE. > > > On Mon, Feb 25, 2019 at 4:25 PM Sasa Drnjevic <sasa.drnje...@srce.hr> > wrote: > >> FYI, >> same here...but my range/ratio was: >> >> ~2 mil occ to 25 mil deleted objects... >> >> Never solved the mystery... gave up :-> >> >> >> -- >> Sasa Drnjevic >> www.srce.unizg.hr/en/ >> >> >> >> >> On 2019-02-25 20:05, Zoltan Forray wrote: >> > Here is a new one....... >> > >> > We turned off backing up SystemState last week. Now I am going through >> and >> > deleted the Systemstate filesystems. >> > >> > Since I wanted to see how many objects would be deleted, I did a "Q >> > OCCUPANCY" and preserved the file count numbers for all Windows nodes on >> > this server. >> > >> > For 4-nodes, the delete of their systemstate filespaces has been running >> > for 5-hours. A "Q PROC" shows: >> > >> > 2019-02-25 08:52:05 Deleting file space >> > ORION-POLL-WEST\SystemState\NULL\System State\SystemState (fsId=1) >> (backup >> > data) for node ORION-POLL-WEST: *105,511,859 objects deleted*. >> > >> > Considering the occupancy for this node was *~5-Million objects*, how >> has >> > it deleted *105-Million* objects (and counting). The other 3-nodes in >> > question are also up to *>100-Million objects deleted* and none of them >> had >> > more than *6M objects* in occupancy? >> > >> > At this rate, the deleting objects count for 4-nodes systemstate will >> > exceed 50% of the total occupancy objects on this server that houses the >> > backups for* 263-nodes*? >> > >> > I vaguely remember some bug/APAR about systemstate backups being >> > large/slow/causing performance problems with expiration but these nodes >> > client levels are fairly current (8.1.0.2 - staying below the >> 8.1.2/SSL/TLS >> > enforcement levels) and the ISP server is 7.1.7.400. All of these are >> > Windows 2016, if that matters. >> > >> > -- >> > *Zoltan Forray* >> > Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator >> > Xymon Monitor Administrator >> > VMware Administrator >> > Virginia Commonwealth University >> > UCC/Office of Technology Services >> > www.ucc.vcu.edu >> > zfor...@vcu.edu - 804-828-4807 >> > Don't be a phishing victim - VCU and other reputable organizations will >> > never use email to request that you reply with your password, social >> > security number or confidential personal information. For more details >> > visit http://phishing.vcu.edu/ >> > >> > > > -- > *Zoltan Forray* > Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator > Xymon Monitor Administrator > VMware Administrator > Virginia Commonwealth University > UCC/Office of Technology Services > www.ucc.vcu.edu > zfor...@vcu.edu - 804-828-4807 > Don't be a phishing victim - VCU and other reputable organizations will > never use email to request that you reply with your password, social > security number or confidential personal information. For more details > visit http://phishing.vcu.edu/ > -- *Zoltan Forray* Spectrum Protect (p.k.a. TSM) Software & Hardware Administrator Xymon Monitor Administrator VMware Administrator Virginia Commonwealth University UCC/Office of Technology Services www.ucc.vcu.edu zfor...@vcu.edu - 804-828-4807 Don't be a phishing victim - VCU and other reputable organizations will never use email to request that you reply with your password, social security number or confidential personal information. For more details visit http://phishing.vcu.edu/
