GDG file not found

[dabills]

We just upgraded to v5.0.0 from v4.5.0 and we are getting sporadic file not found errors when transferring GDG files from the mainframe using CoZ SFTP to different unix/Linux servers. In each case, there are multiple GDG files being transferred in the SFTP job. For instance:
PUT //FILE.GDG.TEST(+0) FILE.GDG.TEST
PUT //FILE.GDG.TEST2(+0) FILE.GDG.TEST2
PUT //FILE.GDG.TEST3(+0) FILE.GDG.TEST3
PUT //FILE.GDG.TEST4(+0) FILE.GDG.TEST4
PUT //FILE.GDG.TEST5(+0) FILE.GDG.TEST5

The first four transfers work fine but the last transfer never starts because of errors like this:
.94.349. Couldn't open local file "//FILE.GDG.TEST5(+0)" for reading: EDC5129I No such file or directory. (errno2=0x0594003D)

or

.73.050. stat //FILE.GDG.TEST5(0): not found

The GDG files definitely exist and I ran SMF reports to make sure nothing else had the affected file allocated. We are not sure where to go next to figure this out other than backing out v5.0.0.

Also, when we resubmit the file transfer with just the affected file (.ie. FILE.GDG.TEST5(+0) or FILE.GDG.TEST5(0), it works just fine.

Do you have any ideas why we are getting the above errors even though the GDG files exist?

[dabills]

I reran the file transfer with -vvv to get more diagnostics and got the following:
ZosDatasetÝI¨: Closing dataset //FILE.MAIN1.FRAME.GDG.G5273V00 - 1 record
Ý14.225¨ debug3: Sent message SSH2_FXP_CLOSE I:23
Ý14.227¨ debug3: SSH2_FXP_STATUS 0
Ý14.230¨ debug3: Sent message fd 7 T:17 I:24
Ý14.231¨ debug3: Received stat reply T:105 I:24
Ý14.231¨ debug3: remote_is_dir: path="/stage_data/cis/MAIN1.GDG" isDir=0
ZosSettingsÝI¨: Transfer options: clientcp=IBM-037,linerule=crnl,mode=text,serve
ZosDatasetÝI¨: Opening dataset FILE.MAIN2.FRAME.GDG(0) for read with options: shr
Ý14.248¨ debug3: Sent message SSH2_FXP_OPEN I:25 O:x1a P:/stage_data/cis/MAIN1.GDG
Ý14.250¨ debug3: Sent message SSH2_FXP_WRITE I:26 O:0 S:55
Ý14.251¨ debug3: SSH2_FXP_STATUS 0
Ý14.252¨ debug3: In write loop, ack for 26 55 bytes at 0
ZosDatasetÝI¨: Closing dataset //FILE.MAIN2.FRAME.GDG.G5140V00 - 1 records read, 55 bytes sent
Ý14.253¨ debug3: Sent message SSH2_FXP_CLOSE I:26
Ý14.256¨ debug3: SSH2_FXP_STATUS 0
Ý14.260¨ stat //FILE.MAIN3.FRAME.GDG(0): not found
Ý14.260¨ debug3: process_put() err=-1
debug2: channel 0: read<=0 rfd 5 len 0
debug2: channel 0: read failed
debug2: channel 0: close_read

FILE.MAIN3.FRAME.GDG(0) does exist and the transfer worked just fine when I customized the job and sent just that file.

I ended up backing out the upgrade of v5.0.0 back to v4.5.0. We do not have the problem using v4.5.0.

Please let me know if you have any idea how to resolve the issue using v5.0.0. Thanks.

[dovetail]

Please try collecting a trace with the following trace options:

export COZ_LOG=F,CatalogSearch=F

and -vvv on the cozsftp command.

You can email the trace to info at dovetail.com

[dovetail]

Also:

Is the GDG that is failing also referenced earlier in the same job? If so, then you will probably want to use the GDGNT option.

[dabills]

No, the GDG is not reference earlier in the same job. I'll try coding GDGNT to see if that makes a difference but these GDG are just being read, not created.

Also, I sent the trace file to the info email. Thanks.

[dovetail]

As we discussed off line, this turned out to be a bug introduced in 5.0.0 which affected catalog results from some GDGs.

We have released a fix for this today (release 5.1.1)

https://dovetail.com/docs/cozinstall/changes.html

Thank you for reporting this issue and assisting us to resolve and verify

[dmhines]

Good morning .. I ran into this issue this morning with 5.0.0 .... Until I can install the latest version we did seem to find a workaround .. if we issue an ls /+ command before try to get the GDG it works ...

Co:Z SFTP Server version: 5.0.0 (6.4p1) 2018-01-10
Copyright (C) Dovetailed Technologies, LLC. 2008-2018. All rights reserved.
Ý08.940¨ session opened for local user FTPPHEAT from Ý15x¨
Connection established, local_addr=15x local_port=22 remote_addr=15x
Ý28.240¨ sent status No such file
Ý37.092¨ opendir "/+/"
Ý37.180¨ closedir "/+/"
Ý41.231¨ open "//N427.ESTAT.C.DAILY.CSTCSTSR(-0)" flags READ mode 0666
ZosSettingsÝI¨: Transfer options: clientcp=ISO8859-1,linerule=crlf,mode=text,ser
ZosDatasetÝI¨: Opening dataset N427.ESTAT.C.DAILY.CSTCSTSR(-0) for read with opt
Ý44.632¨ close "//N427.ESTAT.C.DAILY.CSTCSTSR(-0)" bytes read 8945732 written 0
ZosDatasetÝI¨: Closing dataset //N427.ESTAT.C.DAILY.CSTCSTSR.G3944V00 - 72143 re
Ý20.838¨ session closed for local user FTPPHEAT from Ý15x