Re: [gentoo-user] PostgreSQL Vs MySQL @Uber
On Monday, August 01, 2016 09:07:05 PM Rich Freeman wrote: > On Mon, Aug 1, 2016 at 1:31 PM, J. Roeleveld wrote: > > On Monday, August 01, 2016 11:01:28 AM Rich Freeman wrote: > >> Neither my employer nor the big software provider > >> in question is likely to attract top-notch DB talent (indeed, mine has > >> steadily gotten rid of anybody who knows how to do anything in Oracle > >> beyond creating schemas it seems, > > > > Actively? Or by simply letting the good ones go while replacing them with > > someone less clued up? > > A bit of both. A big part of it was probably sacking anybody doing > anything other than creating tables (since you can't keep operating > without that), and outsourcing to 3rd parties and wanting > bottom-dollar prices. Yes, one of the more common decisions. Often because the person hired to handle the department comes from an outsourcing company or because they happen to meet at the golf course. > There are accidentally some reasonably competent people in IT at my > company, but I don't think it is because we really are good at > targeting world-class talent. I wonder which companies are actually good at that? > > The problem is that the likes of Informatica (one > > of the leading ETL software vendors) don't actually support PostgreSQL. > > Please tell me that it actually does support xml in a sane way, and it > is only our incompetent developers who seem to be hand-generating xml > files by printing strings? There are actually 2 supported methods (not counting randomly sticking strings together): 1) The default XML handling (source/target and transformation). This sort-of works for "simple" XML files. The definition for "simple" is in the sales- contract: No more then ?? levels deep, XSD less then ???MB and XML file less than ???MB. I don't remember the actual numbers, but check with whoever has the actual contract in your company. It should be listed there or call Informatica support. 2) B2B / UDO. The UDO stands for Unstructured Data Option. Bit strange, but that's where it lives. It's a proper XML handling engine that should be able to handle any XML you care to throw at it. Also documents with a standardised layout. It's the preferred method of handling XML files with Informatica. (Do use at least 9.6.1 for this. 9.5 has a very annoying feature... > I have an integration that involves Informatica, and another solution > that just synchronizes files from an smb share to a foreign FTP site. > Of course I don't have access to the share that lies in-between, so > when the interface breaks I get to play with two different groups to > try to figure out where the process died. Informatica appears to be > running on Unix and I get helpful questions from the maintainers about > what path the files are on, as if I'd have any idea where some SMB > share (whose path I am not told) is mounted on some Unix server I have > no access to. Check the session-log (from Informatica), that should contain the actual path Informatica uses to write the file to. > Gotta love division of labor. Heaven forbid anybody have visibility > to the full picture so that the right group can be engaged on the > first try... I see this all too often. They usually claim it's because of security. Not understanding that by obscuring all the details, the first person to get the full picture is the one going to cause havoc and the people that are then tasked to fix it, don't know enough to do it right in a reasonable time-frame. -- Joost
Re: [gentoo-user] cross-compile attempt
On Monday 01 Aug 2016 17:21:52 Mick wrote: > On Monday 01 Aug 2016 16:49:15 Mick wrote: > > Thank you Peter, I seem to have posted a few seconds before I received > > your message. From what you're showing above I seem to have not > > performed a correct mount of the chroot fs. I better rinse and repeat > > ... > > Hmm ... I followed the handbook this time to make sure all is correctly > mounted: > > gentoo-32bit # mount | grep 32bit > proc on /mnt/iso/gentoo-32bit/proc type proc (rw,relatime) > sysfs on /mnt/iso/gentoo-32bit/sys type sysfs > (rw,nosuid,nodev,noexec,relatime) > debugfs on /mnt/iso/gentoo-32bit/sys/kernel/debug type debugfs > (rw,nosuid,nodev,noexec,relatime) > fusectl on /mnt/iso/gentoo-32bit/sys/fs/fuse/connections type fusectl > (rw,nosuid,nodev,noexec,relatime) > efivarfs on /mnt/iso/gentoo-32bit/sys/firmware/efi/efivars type efivarfs > (rw,nosuid,nodev,noexec,relatime) > cgroup_root on /mnt/iso/gentoo-32bit/sys/fs/cgroup type tmpfs > (rw,nosuid,nodev,noexec,relatime,size=10240k,mode=755) > openrc on /mnt/iso/gentoo-32bit/sys/fs/cgroup/openrc type cgroup > (rw,nosuid,nodev,noexec,relatime,release_agent=/lib64/rc/sh/cgroup-release > - agent.sh,name=openrc) > cpuset on /mnt/iso/gentoo-32bit/sys/fs/cgroup/cpuset type cgroup > (rw,nosuid,nodev,noexec,relatime,cpuset) > cpu on /mnt/iso/gentoo-32bit/sys/fs/cgroup/cpu type cgroup > (rw,nosuid,nodev,noexec,relatime,cpu) > cpuacct on /mnt/iso/gentoo-32bit/sys/fs/cgroup/cpuacct type cgroup > (rw,nosuid,nodev,noexec,relatime,cpuacct) > blkio on /mnt/iso/gentoo-32bit/sys/fs/cgroup/blkio type cgroup > (rw,nosuid,nodev,noexec,relatime,blkio) > freezer on /mnt/iso/gentoo-32bit/sys/fs/cgroup/freezer type cgroup > (rw,nosuid,nodev,noexec,relatime,freezer) > net_cls on /mnt/iso/gentoo-32bit/sys/fs/cgroup/net_cls type cgroup > (rw,nosuid,nodev,noexec,relatime,net_cls) > net_prio on /mnt/iso/gentoo-32bit/sys/fs/cgroup/net_prio type cgroup > (rw,nosuid,nodev,noexec,relatime,net_prio) > pids on /mnt/iso/gentoo-32bit/sys/fs/cgroup/pids type cgroup > (rw,nosuid,nodev,noexec,relatime,pids) > dev on /mnt/iso/gentoo-32bit/dev type devtmpfs > (rw,nosuid,relatime,size=10240k,nr_inodes=1915538,mode=755) > mqueue on /mnt/iso/gentoo-32bit/dev/mqueue type mqueue > (rw,nosuid,nodev,noexec,relatime) > devpts on /mnt/iso/gentoo-32bit/dev/pts type devpts > (rw,nosuid,noexec,relatime,gid=5,mode=620) > shm on /mnt/iso/gentoo-32bit/dev/shm type tmpfs > (rw,nosuid,nodev,noexec,relatime) > > > I must be doing some newbie error ... because I still get: > > gentoo-32bit # linux32 chroot /mnt/iso/gentoo-32bit /bin/bash > chroot: failed to run command ‘/bin/bash’: No such file or directory > > > what would this error be? :-/ I can't see your 32-bit file-system in that list. It couldn't be that simple, could it? -- Rgds Peter
Re: [gentoo-user] Re: [was cross-compile attempt] 32bit chroot
On Monday 01 Aug 2016 18:57:53 Mick wrote: > On Monday 01 Aug 2016 17:32:58 Mick wrote: --->8 > > Am I missing something in the amd64 kernel to be able to execute 32bit > > code? > No, I was missing the *whole* of the 32bit fs /lib directory. O_O Oops. I wasn't going to own up to this, but a week or two ago I managed to wipe out my entire /lib64 directory with some careless copy-and-pasting. I couldn't even shut the machine down and had to pull the plug. I wouldn't have minded so much but I'd only just finished building the system on the plasma profile and hadn't yet backed it up. It took me over a week to get established again, what with the current fragility of the whole plasma system. :( -- Rgds Peter
Re: [gentoo-user] cross-compile attempt
On Mon, 01 Aug 2016 16:49:15 +0100, Mick wrote: > Thank you Peter, I seem to have posted a few seconds before I received > your message. From what you're showing above I seem to have not > performed a correct mount of the chroot fs. I better rinse and > repeat ... If you are using systemd, it is much simpler to use a container with systemd-nspawn that chroot, it takes care of all the mucking around required to get /dev, /proc and friends available to the container. The only mount I need to take care of myself is for $PKGDIR, which is also available via NFS on the target box. -- Neil Bothwick Top Oxymorons Number 21: "Now, then ..." pgpG0H1PO2Ctq.pgp Description: OpenPGP digital signature
Re: [gentoo-user] Re: [was cross-compile attempt] 32bit chroot
On Tue, 02 Aug 2016 10:22:09 +0100, Peter Humphrey wrote: > > No, I was missing the *whole* of the 32bit fs /lib directory. O_O > > Oops. I wasn't going to own up to this, but a week or two ago I managed > to wipe out my entire /lib64 directory with some careless > copy-and-pasting. I couldn't even shut the machine down and had to pull > the plug. I recently had a package giving problems, I couldn't downgrade through portage because the old version was gone, but I still had a binary package so I untarred it into /. It replaced my /lib symlink with a directory containing just the one file from that package. Then I started wondering why virtually nothing worked :( -- Neil Bothwick Bus: (n.) a connector you plug money into, something like a slot machine. pgpaGUl63Akrm.pgp Description: OpenPGP digital signature
Re: [gentoo-user] PostgreSQL Vs MySQL @Uber
On Fri, Jul 29, 2016 at 4:58 PM, Mick wrote: > Interesting article explaining why Uber are moving away from PostgreSQL. I am > running both DBs on different desktop PCs for akonadi and I'm also running > MySQL on a number of websites. Let's which one goes sideways first. :p > > https://eng.uber.com/mysql-migration/ > There is a thread on this on the Postgres lists as well (unsurprisingly): https://www.postgresql.org/message-id/flat/579795DF.10502%40commandprompt.com#579795df.10...@commandprompt.com I'm only halfway through it but the Postgres devs strike me as being very levelheaded and competent. They seem to acknowledge the genuine issues and point of some of the tradeoffs that Uber is making without pointing them out. One thing I really did like about the Uber post was that even if it isn't a complete/fair comparison/etc it is really informative as an introduction into how some of the architecture works. The same applies to much of the Postgres thread. I found it really useful for understanding how both indexing/replication solutions work under the hood. -- Rich
