netcdf 4.3.3-1.2: HDF5 library version mismatched error

2016-02-17 Thread Alexander Barth
Hi,

When I run the command:

 ncdump.exe -h test_hgroups.nc

with the example NetCDF4 file from
https://www.unidata.ucar.edu/software/netcdf/examples/test_hgroups.nc,
I get the following HDF5 error message below, in particular:
Headers are 1.8.15, library is 1.8.16

Is it possible to recompile netcdf with the current version of HDF5?

This also affects octave-netcdf and possibly all programs which use netcdf.

Thank you for your fine work to maintain cygwin over all these years!

Regards,
Alexander Barth

Warning! ***HDF5 library version mismatched error***
The HDF5 header files used to compile this application do not match
the version used by the HDF5 library to which this application is linked.
Data corruption or segmentation faults may occur if the application continues.
This can happen when an application was compiled by one version of HDF5 but
linked with a different version of static or shared HDF5 library.
You should recompile the application or check your shared library related
settings such as 'LD_LIBRARY_PATH'.
You can, at your own risk, disable this warning by setting the environment
variable 'HDF5_DISABLE_VERSION_CHECK' to a value of '1'.
Setting it to 2 or higher will suppress the warning messages totally.
Headers are 1.8.15, library is 1.8.16
SUMMARY OF THE HDF5 CONFIGURATION
=

General Information:
---
   HDF5 Version: 1.8.16
  Configured on: Fri Nov 13 18:23:58 CET 2015
  Configured by: marco@GE-MATZERI-EU
 Configure mode: production
Host system: x86_64-unknown-cygwin
  Uname information: CYGWIN_NT-6.1 GE-MATZERI-EU
2.3.0(0.291/5/3) 20
15-11-09 10:24 x86_64
Cygwin
   Byte sex: little-endian
  Libraries: shared
 Installation point: /usr

Compiling Options:
--
   Compilation Mode: production
 C Compiler: /usr/bin/gcc
 CFLAGS: -ggdb -O2 -pipe
-Wimplicit-function-declaration

-fdebug-prefix-map=/pub/devel/hdf5/hdf5-1.8.16-1.x86_64/build=/usr/src/debug/hd

f5-1.8.16-1
-fdebug-prefix-map=/pub/devel/hdf5/hdf5-1.8.16-1.x86_64/src/hdf5-1.8

  .16=/usr/src/debug/hdf5-1.8.16-1
  H5_CFLAGS:
  AM_CFLAGS:
   CPPFLAGS:
H5_CPPFLAGS:   -DNDEBUG -UH5_DEBUG_API
AM_CPPFLAGS:
   Shared C Library: yes
   Static C Library: no
  Statically Linked Executables: no
LDFLAGS:
 H5_LDFLAGS:  -no-undefined
 AM_LDFLAGS:
Extra libraries: -lz -ldl -lm
   Archiver: ar
 Ranlib: ranlib
  Debugged Packages:
API Tracing: no

Languages:
--
Fortran: no

C++: yes
   C++ Compiler: /usr/bin/g++
  C++ Flags: -ggdb -O2 -pipe
-fdebug-prefix-map=/pub/devel/h

df5/hdf5-1.8.16-1.x86_64/build=/usr/src/debug/hdf5-1.8.16-1
-fdebug-prefix-map=/

pub/devel/hdf5/hdf5-1.8.16-1.x86_64/src/hdf5-1.8.16=/usr/src/debug/hdf5-1.8.16-1
   H5 C++ Flags:
   AM C++ Flags:
 Shared C++ Library: yes
 Static C++ Library: no

Features:
-
  Parallel HDF5: no
 High Level library: yes
   Threadsafety: no
Default API Mapping: v18
 With Deprecated Public Symbols: yes
 I/O filters (external): deflate(zlib)
MPE: no
 Direct VFD: no
dmalloc: no
Clear file buffers before write: yes
   Using memory checker: no
 Function Stack Tracing: no
  Strict File Format Checks: no
   Optimization Instrumentation: no
Bye...
Aborted (core dumped)


cygcheck.out
Description: Binary data
--
Problem reports:   http://cygwin.com/problems.html
FAQ:   http://cygwin.com/faq/
Documentation: http://cygwin.com/docs.html
Unsubscribe info:  http://cygwin.com/ml/#unsubscribe-simple

Cygwin 1.7-58 with windows 2008

2016-02-17 Thread Rashi Singhal
We tried with latest version also . But problem remain same

--
Problem reports:   http://cygwin.com/problems.html
FAQ:   http://cygwin.com/faq/
Documentation: http://cygwin.com/docs.html
Unsubscribe info:  http://cygwin.com/ml/#unsubscribe-simple



Re: netcdf 4.3.3-1.2: HDF5 library version mismatched error

2016-02-17 Thread Marco Atzeri

On 17/02/2016 09:37, Alexander Barth wrote:

Hi,

When I run the command:

  ncdump.exe -h test_hgroups.nc

with the example NetCDF4 file from
https://www.unidata.ucar.edu/software/netcdf/examples/test_hgroups.nc,
I get the following HDF5 error message below, in particular:
Headers are 1.8.15, library is 1.8.16

Is it possible to recompile netcdf with the current version of HDF5?

This also affects octave-netcdf and possibly all programs which use netcdf.

Thank you for your fine work to maintain cygwin over all these years!

Regards,
Alexander Barth



Noted.
Unfortunately hdf5 is very poor in maintaining compatibility.
In theory 1.8.15 and 1.8.16 should be API compatible...

I was planning to wait octave 4.0.1 before bumping netcdf to 4.4.0.

But I will prepare  netcdf-4.4.0 and netcdf-fortran-4.4.3 and bump
netcdf-cxx4-4.2.1 just to be sure.

Regards
Marco






--
Problem reports:   http://cygwin.com/problems.html
FAQ:   http://cygwin.com/faq/
Documentation: http://cygwin.com/docs.html
Unsubscribe info:  http://cygwin.com/ml/#unsubscribe-simple



Re: Cygwin 1.7-58 with windows 2008

2016-02-17 Thread Marco Atzeri

On 17/02/2016 09:44, Rashi Singhal wrote:

We tried with latest version also . But problem remain same


Assuming you are using IPC cygserver calls
https://cygwin.com/cygwin-ug-net/using-cygserver.html

Is cygserver service running ?

In general it will be difficult to replicate your problem
without a (simple) test case.

Please follow also general guideline
https://cygwin.com/problems.html

specially this point with 2.4.1 release, please

"Run cygcheck -s -v -r > cygcheck.out and include that file as an 
attachment in your report. Please do not compress or otherwise encode 
the output. Just attach it as a straight text file so that it can be 
easily viewed. "



PS:
 1.7-58 was a test release of 2009
https://sourceware.org/ml/cygwin-announce/2009-08/msg00020.html

Regards
Marco

--
Problem reports:   http://cygwin.com/problems.html
FAQ:   http://cygwin.com/faq/
Documentation: http://cygwin.com/docs.html
Unsubscribe info:  http://cygwin.com/ml/#unsubscribe-simple



Re: Possible Security Hole in SSHD w/ CYGWIN?

2016-02-17 Thread Corinna Vinschen
On Feb 16 20:55, David Willis wrote:
> First let me say that I'm not too well-versed in coding and the ins and outs
> of how processes utilize credentials when they are spawned. However, the
> jist of it seems to be that if there are no credentials saved with passwd -R
> to replace the current user token with that of the user that is SSH'd in,
> then there is no way to change that token at all (or get rid of it) meaning
> the token used when accessing a share will stay as the token of the caller -
> namely cyg_server? Please correct me if I'm way off-base but that seems to
> be my interpretation of this.

It's wrong, but it's not easy to grok how this all works under the hood.
First of all, refering to
https://cygwin.com/cygwin-ug-net/ntsec.html#ntsec-setuid-overview, only
method 1 should be affected.

There are two concepts at work here, one is the user token attached to
each process and defining group membership, permissions and privileges
of a process, the other one is the logon session in which the processes
are running.

The process started by sshd is running with a user token which belongs
to the user the process is supposed to run with.  The group memberships,
the permissions and privileges are set as desired.

However, the network credential are apparently not stored in the user token,
but are connected to the logon session.  And here comes the difference
between method 1 and the other two methods:

- In method 1, Cygwin creates a user token from scratch.  This occurs
  inside the Cygwin DLL itself and so in normal user space.  In Windows,
  there's no way to create a new logon session outside of the LSA.  And
  given that we don't have any credentials to authenticate the new user
  account (remember: we're trying to switch the user context without
  having to specify a password) we have no choice other than to run the
  new processes using the new user token under the logon session of the
  current user.  That's "cyg_server" usually.  Thus, the process has a
  user token for the correct user, but shares the logon session with the
  cyg_server process.

- When using method 2, the Cygwin DLL calls into the Cygwin authentication
  package which is running inside the LSA.  Therefore the authentication
  package can request a new logion session and attach it to the user token
  created inside the LSA.  So the new process is running in it's own
  logon session and thus not sharing the logon session with cyg_server.

- When using method 3, the token is created using the LogonUser function
  which calls into the LSA by itself.  The new user token is running in
  its own logon session.

> If that is the case, it seems this is an unintended side effect of the way
> CYGWIN and sshd work together, and with the current state of Windows there
> isn't really a way around it.

There might be a way around that.  I have a vague idea what to do to
create a new logon session, even when creating the token from scratch
per method 1, which would not share the network credentials of the
caller.  But it's just that yet, an idea.

If anybody has an idea how to perform this action, please share!


Corinna

-- 
Corinna Vinschen  Please, send mails regarding Cygwin to
Cygwin Maintainer cygwin AT cygwin DOT com
Red Hat


signature.asc
Description: PGP signature


Re: locate and updatedb

2016-02-17 Thread Byron Boulton

On 2/16/2016 5:55 PM, Buchbinder, Barry (NIH/NIAID) [E] wrote:

Linda Walsh sent the following at Saturday, February 13, 2016 7:15 AM

Marco Atzeri wrote: ---

On 11/02/2016 19:33, Byron Boulton wrote:

On 2/11/2016 1:18 PM, cyg Simple wrote:

On 2/11/2016 9:00 AM, Byron Boulton wrote:

Does anyone here have success using `updatedb` and `locate` in
cygwin? I use `locate` heavily on my Linux machines, but everytime
I've tried to run `updatedb` on cygwin I've given up and killed the
process because it is taking too long.

There's a reason why on linux it is usually set to run when you are asleep.  ;-)


  Is there something wrong with cygwin's implementation of
`updatedb` making it not work at all or making it slower that on my
Linux machines? Or are there others who have success using it on
cygwin?


But it might have to do with disk speed and memory. Laptop drives are
usually among the slowest.

I ran it just now (this is with MS's Home Essentials real-time
protection turned on).

locate / >/tmp/all
wc /tmp/all

  1479146   4014375 133322318 /tmp/all

df .


law.Bliss/bin> time index_files.sh 670592 (process ID) old priority 0,
new priority 19 44.21sec 15.06usr 28.30sys (98.09% cpu) Filesystem Size
Used Avail Use% Mounted on C: 949G 585G 365G 62% / 

So ~1.4 million files... Using the following exclusions:
  Local+=" /windows/sysnative/."

---(index_files.sh) renice +19 $$ Local="/" if [[ -d
/windows/sysnative/. ]]; then fi Prunepaths='/.usr /proc /C /B /H /I
/M /D /P /System[[:space:]]Volume[[:space:]]Information /Windows/CSC
/pagefile.sys /Music /Pictures /Share /Media /home /Doc /$RECYCLE.BIN
/cygdrive'

/bin/updatedb --findoptions=-noleaf --localpaths="$Local"
--prunepaths="$Prunepaths" --netpaths="$Net"  Most of those pruned
files are pruned either due to redundancy or being on a local network
server...

That's fairly fast vs. the MS-Home Essentials, full malware scan I
run once a week that takes ~ 8-16 hours (It scans a few of my network
directories,as well).


Processing every file on the drive will be slow just because it's
Windows.  Initializing the database with updatedb will require a large
amount of time.  There are processes such as AntiVirus intrusion
protection that might make it even slower.


Hmmm, the reason the slowness is particuarly strange to me is that in
place of using `locate` from my cygwin terminal, I have to use a program
called "Everything Search Engine" available at www.voidtools.com. The
first time I install it, it takes maybe a few minutes to index the hard
drive, then every once in a while when I open the program it takes a few
seconds to update the index, but in general the performance for indexing
and searching the index if comparable to `updatedb` and `locate` on a
Linux machine, so it's possible to do on Windows.

Byron



the time taken from updatedb is mainly due to
the execution time of "find" on the disks.

It takes ~ 70 minutes for my 500 GB of data,
and likely the AV is impacting the execution.

I suspect voidtools is using MS disk indexing
to speed up the things for it.


This is technically OT since this involved a non-cygwin tool.

find is slow compared with a non-Cygwin tool, specifically dir (cmd.exe).

Compare find with cmd.exe's dir.  Note that even with the benefit of
caching (compare the 1st and 3rd times), find takes twice as long as dir.
Comparing cached times (2nd vs 3rd), dir is 3X faster.

$ time cmd /c dir /s /b 'C:\usr' > /dev/null ; \
time find /c/usr > /dev/null ; \
time cmd /c dir /s /b 'C:\usr' > /dev/null

real0m1.326s
user0m0.000s
sys 0m0.047s

real0m2.465s
user0m0.280s
sys 0m2.184s

real0m0.874s
user0m0.000s
sys 0m0.031s

(Note: c:\usr has nothing to do with /usr.)

Here's how I use dir *in the abstract* for drives C: and D:.  (Note: the
/a: option of dir lists all files, including hidden ones; /o:n sorts by
name.)

for D in /c /d
do
 "$(cygpath "${COMSPEC}")" /c dir /s /b /a: /o:n "$(cygpath -w "$D")"
done | \
tr -s '\r\n' '\n' | \
cygpath -u -f - | \
sed -e '/^$/d' -e 's,/\+,/,g' \
sort -u \
/usr/libexec/frcode > /tmp/updatedb.tmp
chmod --reference /var/locatedb /tmp/updatedb.tmp
mv /tmp/updatedb.tmp /var/locatedb

What I actually do (attached) is more complicated.  My script chooses
which directories are scanned, does them in parallel, and prints pretty
messages.  I get error message for very long paths (> ~250 bytes).  It
works well enough for me; YMMV.

- Barry
   Disclaimer: Statements made herein are not made on behalf of NIAID.



--
Problem reports:   http://cygwin.com/problems.html
FAQ:   http://cygwin.com/faq/
Documentation: http://cygwin.com/docs.html
Unsubscribe info:  http://cygwin.com/ml/#unsubscribe-simple



Barry,

Are you using dir in some sort of custom way to build the database used 
by locate? Or are you saying that rather than ever using the find 
command to find files, you use a custom script which uses dir?


Byron


--
Problem repor

[ANNOUNCEMENT] Updated: ed-1.13-1

2016-02-17 Thread Marco Atzeri

New version 1.13-1 ofed

is available in the Cygwin distribution:

CHANGES
It is a upstream bugfix release.
http://lists.gnu.org/archive/html/info-gnu/2016-02/msg5.html

DESCRIPTION
GNU ed is a line-oriented text editor. It is used to create, display,
modify and otherwise manipulate text files, both interactively and
via shell scripts. A restricted version of ed, red, can only edit
files in the current directory and cannot execute shell commands.
Ed is the "standard" text editor in the sense that it is the original
editor for Unix, and thus widely available.

HOMEPAGE
http://www.gnu.org/software/ed/

Marco Atzeri

If you have questions or comments, please send them to the
cygwin mailing list at: cygwin (at) cygwin (dot) com .

--
Problem reports:   http://cygwin.com/problems.html
FAQ:   http://cygwin.com/faq/
Documentation: http://cygwin.com/docs.html
Unsubscribe info:  http://cygwin.com/ml/#unsubscribe-simple



[ANNOUNCEMENT] Updated : netcdf 4.4.0-1

2016-02-17 Thread Marco Atzeri

Version 4.4.0-1 of

 libnetcdf-devel
 libnetcdf11
 netcdf

Version 4.4.3-1
 libnetcdf-fortran-devel
 libnetcdf-fortran_6

Version 4.2.1-4
 libnetcdf-cxx4-devel
 libnetcdf-cxx4_1

are available in the Cygwin distribution.

CHANGES
https://github.com/Unidata/netcdf-c/releases
bumped C Api from 7 to 11

https://github.com/Unidata/netcdf-fortran/releases

C++ interface rebuilt to use the bumped Api


DESCRIPTION
NetCDF (network Common Data Form) is a set of software libraries
and machine-independent data formats that support the creation,
access, and sharing of array-oriented scientific data.

HOMEPAGE
http://www.unidata.ucar.edu/software/netcdf/

Marco Atzeri

If you have questions or comments, please send them to the
cygwin mailing list at: cygwin (at) cygwin (dot) com .

--
Problem reports:   http://cygwin.com/problems.html
FAQ:   http://cygwin.com/faq/
Documentation: http://cygwin.com/docs.html
Unsubscribe info:  http://cygwin.com/ml/#unsubscribe-simple



[ANNOUNCEMENT] Updated: qhull-2015.2-1

2016-02-17 Thread Marco Atzeri

Versions 2015.2-1 of
  libqhull-devel
  libqhull_7  (API change)
  qhull

have been uploaded for cygwin

CHANGES
This is an upstream main releases.
For the full changes
https://github.com/qhull/qhull/blob/master/src/Changes.txt

DESCRIPTION
Qhull is a general dimension convex hull program and library
It computes volumes, surface areas, and approximations to
the convex hull.

HOMEPAGE
http://www.qhull.org/

Regards
Marco Atzeri

If you have questions or comments, please send them to the
cygwin mailing list at: cygwin (at) cygwin (dot) com .

--
Problem reports:   http://cygwin.com/problems.html
FAQ:   http://cygwin.com/faq/
Documentation: http://cygwin.com/docs.html
Unsubscribe info:  http://cygwin.com/ml/#unsubscribe-simple



[ANNOUNCEMENT] Updated: octave forge packages

2016-02-17 Thread Marco Atzeri

New version of

octave-netcdf   1.0.8-1

is available in the Cygwin distribution:

ADVISE
On cygwin none of the forge packages is autoloaded,
as some package could change substantially
the normal octave behaviour (eg "nan").

To load any package before usage run
 "pkg load "

see "help pkg" for details.

CHANGES
 Latest upstream packages for octave 4.0.x

DESCRIPTION
The octave-forge project contains contributed functions
for GNU Octave which are not in the main distribution.

HOMEPAGE
http://octave.sourceforge.net

Full documentation and FAQ are available at:
http://octave.sourceforge.net/docs.html
http://octave.sourceforge.net/packages.php

Regards
Marco Atzeri

If you have questions or comments, please send them to the
cygwin mailing list at: cygwin (at) cygwin (dot) com .

--
Problem reports:   http://cygwin.com/problems.html
FAQ:   http://cygwin.com/faq/
Documentation: http://cygwin.com/docs.html
Unsubscribe info:  http://cygwin.com/ml/#unsubscribe-simple



RE: locate and updatedb

2016-02-17 Thread Buchbinder, Barry (NIH/NIAID) [E]
Byron Boulton sent the following at Wednesday, February 17, 2016 8:43 AM
>On 2/16/2016 5:55 PM, Buchbinder, Barry (NIH/NIAID) [E] wrote:
>>
>> This is technically OT since this involved a non-cygwin tool.
>>
>> find is slow compared with a non-Cygwin tool, specifically dir (cmd.exe).
>>
>> Compare find with cmd.exe's dir.  Note that even with the benefit of
>> caching (compare the 1st and 3rd times), find takes twice as long as dir.
>> Comparing cached times (2nd vs 3rd), dir is 3X faster.
>>
>> $ time cmd /c dir /s /b 'C:\usr' > /dev/null ; \ time find /c/usr >
>> /dev/null ; \ time cmd /c dir /s /b 'C:\usr' > /dev/null
>>
>> real0m1.326s
>> user0m0.000s
>> sys 0m0.047s
>>
>> real0m2.465s
>> user0m0.280s
>> sys 0m2.184s
>>
>> real0m0.874s
>> user0m0.000s
>> sys 0m0.031s
>>
>> (Note: c:\usr has nothing to do with /usr.)
>>
>> Here's how I use dir *in the abstract* for drives C: and D:.  (Note:
>> the
>> /a: option of dir lists all files, including hidden ones; /o:n sorts
>> by
>> name.)
>>
>> for D in /c /d
>> do
>>  "$(cygpath "${COMSPEC}")" /c dir /s /b /a: /o:n "$(cygpath -w "$D")"
>> done | \
>> tr -s '\r\n' '\n' | \
>> cygpath -u -f - | \
>> sed -e '/^$/d' -e 's,/\+,/,g' \
>> sort -u \
>> /usr/libexec/frcode > /tmp/updatedb.tmp chmod --reference
>> /var/locatedb /tmp/updatedb.tmp mv /tmp/updatedb.tmp /var/locatedb
>>
>> What I actually do (attached) is more complicated.  My script chooses
>> which directories are scanned, does them in parallel, and prints
>> pretty messages.  I get error messages for very long paths (> ~250
>> bytes).  It works well enough for me; YMMV.
>
>Are you using dir in some sort of custom way to build the database
>used by locate? Or are you saying that rather than ever using the find
>command to find files, you use a custom script which uses dir?

I use dir only to generate the locate database, because scanning the
better part of several disks takes so long.  I do not substitute dir for
find for other purposes.  One could, but usually locate does what I need,
and when it doesn't, I use find.

Best wishes,

- Barry
  Disclaimer: Statements made herein are not made on behalf of NIAID.

--
Problem reports:   http://cygwin.com/problems.html
FAQ:   http://cygwin.com/faq/
Documentation: http://cygwin.com/docs.html
Unsubscribe info:  http://cygwin.com/ml/#unsubscribe-simple



mksh

2016-02-17 Thread Chris Sutcliffe
Hi All,

Looking at the package maintainer list it appears as though mksh is
still orphaned since I stopped maintaining it a couple of years back.
If it's still orphaned, I'm happy to take over ownership again.

Thanks,

Chris

-- 
Chris Sutcliffe

--
Problem reports:   http://cygwin.com/problems.html
FAQ:   http://cygwin.com/faq/
Documentation: http://cygwin.com/docs.html
Unsubscribe info:  http://cygwin.com/ml/#unsubscribe-simple



Re: locate and updatedb

2016-02-17 Thread Byron Boulton

On 2/17/2016 11:00 AM, Buchbinder, Barry (NIH/NIAID) [E] wrote:

Byron Boulton sent the following at Wednesday, February 17, 2016 8:43 AM

On 2/16/2016 5:55 PM, Buchbinder, Barry (NIH/NIAID) [E] wrote:


This is technically OT since this involved a non-cygwin tool.

find is slow compared with a non-Cygwin tool, specifically dir (cmd.exe).

Compare find with cmd.exe's dir.  Note that even with the benefit of
caching (compare the 1st and 3rd times), find takes twice as long as dir.
Comparing cached times (2nd vs 3rd), dir is 3X faster.

$ time cmd /c dir /s /b 'C:\usr' > /dev/null ; \ time find /c/usr >
/dev/null ; \ time cmd /c dir /s /b 'C:\usr' > /dev/null

real0m1.326s
user0m0.000s
sys 0m0.047s

real0m2.465s
user0m0.280s
sys 0m2.184s

real0m0.874s
user0m0.000s
sys 0m0.031s

(Note: c:\usr has nothing to do with /usr.)

Here's how I use dir *in the abstract* for drives C: and D:.  (Note:
the
/a: option of dir lists all files, including hidden ones; /o:n sorts
by
name.)

for D in /c /d
do
  "$(cygpath "${COMSPEC}")" /c dir /s /b /a: /o:n "$(cygpath -w "$D")"
done | \
tr -s '\r\n' '\n' | \
cygpath -u -f - | \
sed -e '/^$/d' -e 's,/\+,/,g' \
sort -u \
/usr/libexec/frcode > /tmp/updatedb.tmp chmod --reference
/var/locatedb /tmp/updatedb.tmp mv /tmp/updatedb.tmp /var/locatedb

What I actually do (attached) is more complicated.  My script chooses
which directories are scanned, does them in parallel, and prints
pretty messages.  I get error messages for very long paths (> ~250
bytes).  It works well enough for me; YMMV.


Are you using dir in some sort of custom way to build the database
used by locate? Or are you saying that rather than ever using the find
command to find files, you use a custom script which uses dir?


I use dir only to generate the locate database, because scanning the
better part of several disks takes so long.  I do not substitute dir for
find for other purposes.  One could, but usually locate does what I need,
and when it doesn't, I use find.

Best wishes,

- Barry
   Disclaimer: Statements made herein are not made on behalf of NIAID.

--
Problem reports:   http://cygwin.com/problems.html
FAQ:   http://cygwin.com/faq/
Documentation: http://cygwin.com/docs.html
Unsubscribe info:  http://cygwin.com/ml/#unsubscribe-simple

locate understands how to read this custom database? If I read you 
updatedb.sh script properly, it produces a file which is just a sorted 
text file with one line per file found by updatedb.sh.


Byron


--
Problem reports:   http://cygwin.com/problems.html
FAQ:   http://cygwin.com/faq/
Documentation: http://cygwin.com/docs.html
Unsubscribe info:  http://cygwin.com/ml/#unsubscribe-simple



RE: locate and updatedb

2016-02-17 Thread Buchbinder, Barry (NIH/NIAID) [E]
Byron Boulton sent the following at Wednesday, February 17, 2016 11:21 AM
>On 2/17/2016 11:00 AM, Buchbinder, Barry (NIH/NIAID) [E] wrote: locate
>> Byron Boulton sent the following at Wednesday, February 17, 2016 8:43
>> AM
>>> On 2/16/2016 5:55 PM, Buchbinder, Barry (NIH/NIAID) [E] wrote:

 This is technically OT since this involved a non-cygwin tool.

 find is slow compared with a non-Cygwin tool, specifically dir (cmd.exe).

 Compare find with cmd.exe's dir.  Note that even with the benefit of
 caching (compare the 1st and 3rd times), find takes twice as long as dir.
 Comparing cached times (2nd vs 3rd), dir is 3X faster.

 $ time cmd /c dir /s /b 'C:\usr' > /dev/null ; \ time find /c/usr >
 /dev/null ; \ time cmd /c dir /s /b 'C:\usr' > /dev/null

 real0m1.326s
 user0m0.000s
 sys 0m0.047s

 real0m2.465s
 user0m0.280s
 sys 0m2.184s

 real0m0.874s
 user0m0.000s
 sys 0m0.031s

 (Note: c:\usr has nothing to do with /usr.)

 Here's how I use dir *in the abstract* for drives C: and D:.  (Note:
 the
 /a: option of dir lists all files, including hidden ones; /o:n sorts
 by
 name.)

 for D in /c /d
 do
   "$(cygpath "${COMSPEC}")" /c dir /s /b /a: /o:n "$(cygpath -w "$D")"
 done | \
 tr -s '\r\n' '\n' | \
 cygpath -u -f - | \
 sed -e '/^$/d' -e 's,/\+,/,g' \
 sort -u \
 /usr/libexec/frcode > /tmp/updatedb.tmp chmod --reference
 /var/locatedb /tmp/updatedb.tmp mv /tmp/updatedb.tmp /var/locatedb

 What I actually do (attached) is more complicated.  My script
 chooses which directories are scanned, does them in parallel, and
 prints pretty messages.  I get error messages for very long paths (>
 ~250 bytes).  It works well enough for me; YMMV.
>>>
>>> Are you using dir in some sort of custom way to build the database
>>> used by locate? Or are you saying that rather than ever using the
>>> find command to find files, you use a custom script which uses dir?
>>
>> I use dir only to generate the locate database, because scanning the
>> better part of several disks takes so long.  I do not substitute dir
>> for find for other purposes.  One could, but usually locate does what
>> I need, and when it doesn't, I use find.
>
>understands how to read this custom database? If I read you updatedb.sh
>script properly, it produces a file which is just a sorted text file
>with one line per file found by updatedb.sh.

Sorry.  In the example in the email text I forgot a pipe sign after sort
and feeding into /usr/libexec/frcode, which convert to located format.
That fragment should have been as follows.

sort -u | \
/usr/libexec/frcode > /tmp/updatedb.tmp

It's really been so long since I put updated.sh together that I would need
to study it to make detailed comments.  Indeed, my memories of putting it
together are lost in the mists of time.

What I'd advise is to use the script that comes with findutils,
/usr/bin/updated, as your model.  Substitute dir for find, adjust start
Points 9drives or directories), convert line endings, etc., and running
through cygpath, and making other necessary changes before running through
frcode.

Sorry that I cannot be of more help.

Good luck.

- Barry
  Disclaimer: Statements made herein are not made on behalf of NIAID.


--
Problem reports:   http://cygwin.com/problems.html
FAQ:   http://cygwin.com/faq/
Documentation: http://cygwin.com/docs.html
Unsubscribe info:  http://cygwin.com/ml/#unsubscribe-simple



Re: mksh

2016-02-17 Thread Yaakov Selkowitz

On 2016-02-17 10:17, Chris Sutcliffe wrote:

Looking at the package maintainer list it appears as though mksh is
still orphaned since I stopped maintaining it a couple of years back.
If it's still orphaned, I'm happy to take over ownership again.


Please feel free to ITA.

--
Yaakov

--
Problem reports:   http://cygwin.com/problems.html
FAQ:   http://cygwin.com/faq/
Documentation: http://cygwin.com/docs.html
Unsubscribe info:  http://cygwin.com/ml/#unsubscribe-simple



Re: mksh

2016-02-17 Thread Corinna Vinschen
On Feb 17 11:17, Chris Sutcliffe wrote:
> Hi All,
> 
> Looking at the package maintainer list it appears as though mksh is
> still orphaned since I stopped maintaining it a couple of years back.
> If it's still orphaned, I'm happy to take over ownership again.

Welcome back!  You want me to de-orphan it in the cygwin-pkg-maint file?


Corinna

-- 
Corinna Vinschen  Please, send mails regarding Cygwin to
Cygwin Maintainer cygwin AT cygwin DOT com
Red Hat


signature.asc
Description: PGP signature


Re: mksh

2016-02-17 Thread Chris Sutcliffe
On 17 February 2016 at 11:56, Corinna Vinschen wrote:
> On Feb 17 11:17, Chris Sutcliffe wrote:
>>
>> Looking at the package maintainer list it appears as though mksh is
>> still orphaned since I stopped maintaining it a couple of years back.
>> If it's still orphaned, I'm happy to take over ownership again.
>
> Welcome back!  You want me to de-orphan it in the cygwin-pkg-maint file?

Thank you!  Yes, please consider it adopted.  As per Yaakov's request
I submitted an ITA to the apps list.

Thank you,

Chris

-- 
Chris Sutcliffe

--
Problem reports:   http://cygwin.com/problems.html
FAQ:   http://cygwin.com/faq/
Documentation: http://cygwin.com/docs.html
Unsubscribe info:  http://cygwin.com/ml/#unsubscribe-simple



Re: mksh

2016-02-17 Thread Corinna Vinschen
On Feb 17 12:06, Chris Sutcliffe wrote:
> On 17 February 2016 at 11:56, Corinna Vinschen wrote:
> > On Feb 17 11:17, Chris Sutcliffe wrote:
> >>
> >> Looking at the package maintainer list it appears as though mksh is
> >> still orphaned since I stopped maintaining it a couple of years back.
> >> If it's still orphaned, I'm happy to take over ownership again.
> >
> > Welcome back!  You want me to de-orphan it in the cygwin-pkg-maint file?
> 
> Thank you!  Yes, please consider it adopted.  As per Yaakov's request
> I submitted an ITA to the apps list.

Done.  You're the old new maintainer :)


Corinna

-- 
Corinna Vinschen  Please, send mails regarding Cygwin to
Cygwin Maintainer cygwin AT cygwin DOT com
Red Hat


signature.asc
Description: PGP signature


Re: mksh

2016-02-17 Thread Chris Sutcliffe
On 17 February 2016 at 12:09, Corinna Vinschen wrote:
> Done.  You're the old new maintainer :)

Thank you!

I have a couple of questions on the ITP process now, but I'll take
that to the apps list.

Thanks,

Chris

-- 
Chris Sutcliffe

--
Problem reports:   http://cygwin.com/problems.html
FAQ:   http://cygwin.com/faq/
Documentation: http://cygwin.com/docs.html
Unsubscribe info:  http://cygwin.com/ml/#unsubscribe-simple



[ANNOUNCEMENT] Updated: mksh-52b-1

2016-02-17 Thread Chris Sutcliffe
Version 52b-1 of "mksh" has been uploaded.

MirBSD Korn Shell, an actively developed free implementation of the
Korn Shell programming language and a successor to the Public Domain
Korn Shell.

ChangeLog:

[tg] Recognise ksh93 compiled scripts and LZIP compressed files as
binary (i.e. to not run as mksh plaintext script)
[tg] Document that we will implement locale tracking later
[tg] Add EEXIST to failback strerror(3)
[jilles] Make set -C; :>foo race-free
[tg] Don’t use unset in portable build script
[tg] Plug warning on GNU/kFreeBSD, GNU/Hurd
[tg] Document read -a resets the integer base
[Jorg] Fix manpage: time is not a builtin but a reserved word
[Jorg, tg] Make exit (and return) eat -1
[tg] parse “$( (( … ) … ) … )” correctly (LP#1532621), Jan Palus
[tg] reduce memory footprint by free(3)ing more aggressively
[tg] fix buffer overrun (LP#1533394), bugreport by izabera
[tg] correctly handle nested ADELIM parsing (LP#1453827), Teckids
[tg] permit “read -A/-a arr[idx]” as long as only one element is read;
fix corruption of array indicēs with this construct (LP#1533396),
izabera
[tg] Sanitise OS-provided signal number in even more places
[tg] As requested by Jorg, be clear manpage advice is for mksh
[tg] Revert (as it was a regression) POSIX bugfix from R52/2005
related to accent gravis-style command substitution until POSIX
decides either way
[tg] Handle export et al. after command (Austin#351)
[tg] Catch EPIPE in built-in cat and return as SIGPIPE (LP#1532621)
[tg] Fix errno in print/echo builtin; optimise that and unbksl
[tg] Update documentation, point out POSIX violation (Austin#1015)

  *** CYGWIN-ANNOUNCE UNSUBSCRIBE INFO ***

If you want to unsubscribe from the cygwin-announce mailing list, look
at the "List-Unsubscribe: " tag in the email header of this message.
Send email to the address specified there. It will be in the format:

cygwin-announce-unsubscribe-you=yourdomain.com  cygwin.com

If you need more information on unsubscribing, start reading here:

http://sourceware.org/lists.html#unsubscribe-simple

Please read *all* of the information on unsubscribing that is
available starting at this URL.

-- 
Chris Sutcliffe

--
Problem reports:   http://cygwin.com/problems.html
FAQ:   http://cygwin.com/faq/
Documentation: http://cygwin.com/docs.html
Unsubscribe info:  http://cygwin.com/ml/#unsubscribe-simple



Re: [ANNOUNCEMENT] Updated: mksh-52b-1

2016-02-17 Thread Keith Christian
On Wed, Feb 17, 2016 at 2:53 PM, Chris Sutcliffe  wrote:
> Version 52b-1 of "mksh" has been uploaded.

Thank you, Chris, for resuming as mksh maintainer.

Keith

--
Problem reports:   http://cygwin.com/problems.html
FAQ:   http://cygwin.com/faq/
Documentation: http://cygwin.com/docs.html
Unsubscribe info:  http://cygwin.com/ml/#unsubscribe-simple



Unknown+User and Unknown+Group when using ls via ssh

2016-02-17 Thread James Whitwell
Hi,

We’re having some trouble when logged in via ssh that we don’t have when we log 
in directly (in our case RDP to the server, then start bash from the Windows 
desktop).  Our environment is Windows Server 2008 R2 64-bit joined to a Samba 
domain, running Cygwin 2.4.1 64-bit.

The problem we’re having seems to be with usernames and groups.  When we’re 
logged in directly, it works perfectly e.g.

WORKFLOW3:jams:~:$ cd /cygdrive/e
WORKFLOW3:jams:/cygdrive/e:$ ls -l
total 12
dr-xr-x---+ 1 jams Domain Users  0 Feb 18 10:36 $RECYCLE.BIN/
drwxrwx---+ 1 wfcron   Domain Users  0 Sep 23 14:13 PDF/
drwxr-x---  1 Unknown+User Unknown+Group 0 Mar  7  2015 System Volume 
Information/
drwxrwx---+ 1 wfcron   Domain Users  0 Sep  7 10:30 Vault/
WORKFLOW3:jams:/cygdrive/e:$ cd PDF
WORKFLOW3:jams:/cygdrive/e/PDF:$ ls -l
total 29696
-rwxrwx---+ 1 wfcron Domain Users 0 Feb 18 17:09 from-cron*
drwxrwx---+ 1 wfcron Domain Users 0 Feb 18 11:15 pdf/
WORKFLOW3:jams:/cygdrive/e/PDF:$

But when I ssh to the machine and try the same commands, I get “Unknown+User” 
and “Unknown+Group” from “ls”, and can’t “cd PDF” e.g.

WORKFLOW3:jams:~:$ cd /cygdrive/e
WORKFLOW3:jams:/cygdrive/e:$ ls -l
total 4
dr-xr-x---+ 1 jams Domain Users  0 Feb 18 10:36 $RECYCLE.BIN/
drwxr-x---  1 Unknown+User Unknown+Group 0 Sep 23 14:13 PDF/
drwxr-x---  1 Unknown+User Unknown+Group 0 Mar  7  2015 System Volume 
Information/
drwxr-x---  1 Unknown+User Unknown+Group 0 Sep  7 10:30 Vault/
WORKFLOW3:jams:/cygdrive/e:$ cd PDF
-bash: cd: PDF: Permission denied
WORKFLOW3:jams:/cygdrive/e:$

I’ve tried strace on the ls via ssh (attached) but can’t see anything obvious 
failing in it.

Thanks,
 James.

——
--- Process 6764 created
--- Process 6764 loaded \Device\HarddiskVolume3\Windows\System32\ntdll.dll at 
76CF
--- Process 6764 loaded \Device\HarddiskVolume3\Windows\System32\kernel32.dll 
at 76AD
--- Process 6764 loaded \Device\HarddiskVolume3\Windows\System32\KernelBase.dll 
at 07FEFBE1
--- Process 6764 loaded \Device\HarddiskVolume3\cygwin\bin\cygwin1.dll at 
00018004
--- Process 6764 loaded \Device\HarddiskVolume3\cygwin\bin\cygintl-8.dll at 
0003FF54
--- Process 6764 loaded \Device\HarddiskVolume3\cygwin\bin\cygiconv-2.dll at 
0003FF5A
1   1 [main] ls (6764) **
   81  82 [main] ls (6764) Program name: C:\cygwin\bin\ls.exe (windows pid 
6764)
   64 146 [main] ls (6764) OS version:   Windows NT-6.1
   17 163 [main] ls (6764) **
   49 212 [main] ls (6764) sigprocmask: 0 = sigprocmask (0, 0x0, 
0x180303168)
  363 575 [main] ls 6764 open_shared: name shared.5, n 5, shared 
0x18003 (wanted 0x18003), h 0x68, *m 6
   37 612 [main] ls 6764 user_heap_info::init: heap base 0x6, heap 
top 0x6, heap size 0x2000 (536870912)
   29 641 [main] ls 6764 open_shared: name 
S-1-5-21-3818554400-921237426-3143208535-5148.1, n 1, shared 0x18002 
(wanted 0x18002), h 0x64, *m 6
   17 658 [main] ls 6764 user_info::create: opening user shared for 
'S-1-5-21-3818554400-921237426-3143208535-5148' at 0x18002
   17 675 [main] ls 6764 user_info::create: user shared version AB1FCCE8
   33 708 [main] ls 6764 fhandler_pipe::create: name 
\\.\pipe\cygwin-c5e39b7a9d22bafb-6764-sigwait, size 11440, mode 
PIPE_TYPE_MESSAGE
   78 786 [main] ls 6764 fhandler_pipe::create: pipe read handle 0x7C
   16 802 [main] ls 6764 fhandler_pipe::create: CreateFile: name 
\\.\pipe\cygwin-c5e39b7a9d22bafb-6764-sigwait
   35 837 [main] ls 6764 fhandler_pipe::create: pipe write handle 0x80
   25 862 [main] ls 6764 dll_crt0_0: finished dll_crt0_0 initialization
--- Process 6764 thread 8028 created
  1951057 [sig] ls 6764 wait_sig: entering ReadFile loop, my_readsig 0x7C, 
my_sendsig 0x80
  2131270 [main] ls 6764 time: 1455776072 = time(0x0)
   571327 [main] ls 6764 mount_info::conv_to_posix_path: conv_to_posix_path 
(C:\cygwin\home\jams, 0x0, no-add-slash)
   341361 [main] ls 6764 normalize_win32_path: C:\cygwin\home\jams = 
normalize_win32_path (C:\cygwin\home\jams)
   221383 [main] ls 6764 mount_info::conv_to_posix_path: /home/jams = 
conv_to_posix_path (C:\cygwin\home\jams)
   321415 [main] ls 6764 sigprocmask: 0 = sigprocmask (0, 0x0, 0x600018128)
  1581573 [main] ls 6764 _cygwin_istext_for_stdio: fd 0: not open
   261599 [main] ls 6764 _cygwin_istext_for_stdio: fd 1: not open
   161615 [main] ls 6764 _cygwin_istext_for_stdio: fd 2: not open
   701685 [main] ls (6764) open_shared: name cygpid.6764, n 6764, shared 
0x18001 (wanted 0x18001), h 0xA8, *m 2
   231708 [main] ls (6764) time: 1455776072 = time(0x0)
   181726 [main] ls 6764 pinfo::thisproc: myself dwProcessId 6764
   651791 [main] ls 6764 environ_init: GetEnvironmentStrings returned 
0x2BD270
   321823 [main] ls 6764 environ_in