Author Topic: bitsharesx-cli v. 0.4.20+a-0ubuntu1~ppa5 process dies  (Read 5204 times)

0 Members and 1 Guest are viewing this topic.

Offline FuLl

  • Full Member
  • ***
  • Posts: 101
    • View Profile
Great! Thank you all for sorting that for me.

I guess I'll have to start paying to run my server then. I hope it's not too expensive to keep up 24/7.

I've just restored a snapshot from when I first discovered it dying- I imagine now it'll stay up. I now have 3.7G of memory, the next larger that was available, & a big jump up.

It just started, & htop shows ~700MB in use.


EDIT:

I just looked at Amazon's pricing, & figured it'll cost ~$50/month, which is more than I want to pay. I'll have to wait until I get my home server up until I can provide a stable seed node, unfortunately.

I hate to have posted that I had a node up on that IP address, just to take it down- I'll have to edit that post & post my office's address in its place once I have that server finished.

Also, now htop is reporting close to 1G RAM in use. No wonder it was crashing.

Thanks again.
« Last Edit: October 09, 2014, 05:26:36 pm by FuLl »

Offline xeroc

  • Board Moderator
  • Hero Member
  • *****
  • Posts: 12922
  • ChainSquad GmbH
    • View Profile
    • ChainSquad GmbH
  • BitShares: xeroc
  • GitHub: xeroc
over here the client (dormant .. just a node) uses 1.135 GB of RAM .. so that is your problem ..
you just need MORE RAM!

Offline cube

  • Hero Member
  • *****
  • Posts: 1404
  • Bit by bit, we will get there!
    • View Profile
  • BitShares: bitcube
588M, AWS EC2 Free Tier.

I move the volume back & forth between it & an xlarge for building.

You do not have enough memory. And EC2 free tier is notorious for killing resource-hungry processes.  Try getting a 2GB RAM instance to run it.  You can easily test it out with an instance. 
ID: bitcube
bitcube is a dedicated witness and committe member. Please vote for bitcube.

Offline FuLl

  • Full Member
  • ***
  • Posts: 101
    • View Profile
588M, AWS EC2 Free Tier.

I move the volume back & forth between it & an xlarge for building.

Offline xeroc

  • Board Moderator
  • Hero Member
  • *****
  • Posts: 12922
  • ChainSquad GmbH
    • View Profile
    • ChainSquad GmbH
  • BitShares: xeroc
  • GitHub: xeroc
Code: [Select]
$ free
             total       used       free     shared    buffers     cached
Mem:        602700     536704      65996      18356      17624     164360
Hu ?!?!
You machine either has 600GB RAM or only 600MB .. anyway .. from that RAM almost everything is already in use
If you had 600MB ram than only 53MB are left free ...

How much RAM do you have?

Offline FuLl

  • Full Member
  • ***
  • Posts: 101
    • View Profile
So much for that theory .. could you run

"free"   (shows amount of free memory)
"df -h /"    (shows amount of free disk)

Code: [Select]
$ free
             total       used       free     shared    buffers     cached
Mem:        602700     536704      65996      18356      17624     164360
-/+ buffers/cache:     354720     247980
Swap:            0          0          0

Code: [Select]
$ df -h /
Filesystem      Size  Used Avail Use% Mounted on
/dev/xvda1       30G   15G   14G  52% /

Offline xeroc

  • Board Moderator
  • Hero Member
  • *****
  • Posts: 12922
  • ChainSquad GmbH
    • View Profile
    • ChainSquad GmbH
  • BitShares: xeroc
  • GitHub: xeroc
So much for that theory .. could you run

"free"   (shows amount of free memory)
"df -h /"    (shows amount of free disk)

Offline FuLl

  • Full Member
  • ***
  • Posts: 101
    • View Profile
Code: [Select]
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.13.0-37-generic (buildd@kapok) (gcc version 4.8.2 (Ubuntu 4.8.2-19ubuntu1) ) #64-Ubuntu SMP Mon Sep 22 21:28:38 UTC 2014 (Ubuntu 3.13.0-37.64-generic 3.13.11.7)
[    0.000000] Command line: root=LABEL=cloudimg-rootfs ro console=hvc0
[    0.000000] KERNEL supported cpus:
[    0.000000]   Intel GenuineIntel
[    0.000000]   AMD AuthenticAMD
[    0.000000]   Centaur CentaurHauls
[    0.000000] ACPI in unprivileged domain disabled
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] Xen: [mem 0x0000000000000000-0x000000000009ffff] usable
[    0.000000] Xen: [mem 0x00000000000a0000-0x00000000000fffff] reserved
[    0.000000] Xen: [mem 0x0000000000100000-0x0000000026efffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] DMI not present or invalid.
[    0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000000] No AGP bridge found
[    0.000000] e820: last_pfn = 0x26f00 max_arch_pfn = 0x400000000
[    0.000000] Scanning 1 areas for low memory corruption
[    0.000000] Base memory trampoline at [ffff88000009a000] 9a000 size 24576
[    0.000000] init_memory_mapping: [mem 0x00000000-0x000fffff]
[    0.000000]  [mem 0x00000000-0x000fffff] page 4k
[    0.000000] init_memory_mapping: [mem 0x26400000-0x265fffff]
[    0.000000]  [mem 0x26400000-0x265fffff] page 4k
[    0.000000] BRK [0x01fed000, 0x01fedfff] PGTABLE
[    0.000000] init_memory_mapping: [mem 0x24000000-0x263fffff]
[    0.000000]  [mem 0x24000000-0x263fffff] page 4k
[    0.000000] BRK [0x01fee000, 0x01feefff] PGTABLE
[    0.000000] BRK [0x01fef000, 0x01feffff] PGTABLE
[    0.000000] BRK [0x01ff0000, 0x01ff0fff] PGTABLE
[    0.000000] BRK [0x01ff1000, 0x01ff1fff] PGTABLE
[    0.000000] BRK [0x01ff2000, 0x01ff2fff] PGTABLE
[    0.000000] init_memory_mapping: [mem 0x00100000-0x23ffffff]
[    0.000000]  [mem 0x00100000-0x23ffffff] page 4k
[    0.000000] init_memory_mapping: [mem 0x26600000-0x26efffff]
[    0.000000]  [mem 0x26600000-0x26efffff] page 4k
[    0.000000] RAMDISK: [mem 0x02403000-0x03859fff]
[    0.000000] NUMA turned off
[    0.000000] Faking a node at [mem 0x0000000000000000-0x0000000026efffff]
[    0.000000] Initmem setup node 0 [mem 0x00000000-0x26efffff]
[    0.000000]   NODE_DATA [mem 0x266fb000-0x266fffff]
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]
[    0.000000]   Normal   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x0009ffff]
[    0.000000]   node   0: [mem 0x00100000-0x26efffff]
[    0.000000] On node 0 totalpages: 159391
[    0.000000]   DMA zone: 64 pages used for memmap
[    0.000000]   DMA zone: 21 pages reserved
[    0.000000]   DMA zone: 3999 pages, LIFO batch:0
[    0.000000]   DMA32 zone: 2428 pages used for memmap
[    0.000000]   DMA32 zone: 155392 pages, LIFO batch:31
[    0.000000] SFI: Simple Firmware Interface v0.81 http://simplefirmware.org
[    0.000000] smpboot: Allowing 1 CPUs, 0 hotplug CPUs
[    0.000000] nr_irqs_gsi: 16
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000fffff]
[    0.000000] e820: [mem 0x26f00000-0xffffffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on Xen
[    0.000000] Xen version: 3.4.3.amazon (preserve-AD)
[    0.000000] setup_percpu: NR_CPUS:256 nr_cpumask_bits:256 nr_cpu_ids:1 nr_node_ids:1
[    0.000000] PERCPU: Embedded 29 pages/cpu @ffff880026000000 s86400 r8192 d24192 u2097152
[    0.000000] pcpu-alloc: s86400 r8192 d24192 u2097152 alloc=1*2097152
[    0.000000] pcpu-alloc: [0] 0
[5847572.601858] xen: PV spinlocks enabled
[5847572.601865] Built 1 zonelists in Node order, mobility grouping on.  Total pages: 156878
[5847572.601866] Policy zone: DMA32
[5847572.601869] Kernel command line: root=LABEL=cloudimg-rootfs ro console=hvc0
[5847572.603518] PID hash table entries: 4096 (order: 3, 32768 bytes)
[5847572.603567] Checking aperture...
[5847572.612779] No AGP bridge found
[5847572.612867] Calgary: detecting Calgary via BIOS EBDA area
[5847572.612869] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
[5847572.615649] Memory: 579008K/637564K available (7375K kernel code, 1144K rwdata, 3404K rodata, 1336K init, 1444K bss, 58556K reserved)
[5847572.615762] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[5847572.615788] Hierarchical RCU implementation.
[5847572.615789]        RCU dyntick-idle grace-period acceleration is enabled.
[5847572.615791]        RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=1.
[5847572.615792]        Offload RCU callbacks from all CPUs
[5847572.615794]        Offload RCU callbacks from CPUs: 0.
[5847572.615805] NR_IRQS:16640 nr_irqs:256 16
[5847572.615958] Console: colour dummy device 80x25
[5847572.616088] console [tty0] enabled
[5847572.616317] console [hvc0] enabled
[5847572.616759] allocated 2621440 bytes of page_cgroup
[5847572.616765] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[5847572.616803] Xen: using vcpuop timer interface
[5847572.616811] installing Xen timer for CPU 0
[5847572.616857] tsc: Detected 1800.000 MHz processor
[5847572.616865] Calibrating delay loop (skipped), value calculated using timer frequency.. 3600.00 BogoMIPS (lpj=7200000)
[5847572.616875] pid_max: default: 32768 minimum: 301
[5847572.617174] Security Framework initialized
[5847572.617210] AppArmor: AppArmor initialized
[5847572.617215] Yama: becoming mindful.
[5847572.617511] Dentry cache hash table entries: 131072 (order: 8, 1048576 bytes)
[5847572.617848] Inode-cache hash table entries: 65536 (order: 7, 524288 bytes)
[5847572.617988] Mount-cache hash table entries: 2048 (order: 2, 16384 bytes)
[5847572.618003] Mountpoint-cache hash table entries: 2048 (order: 2, 16384 bytes)
[5847572.618315] Initializing cgroup subsys memory
[5847572.618332] Initializing cgroup subsys devices
[5847572.618338] Initializing cgroup subsys freezer
[5847572.618344] Initializing cgroup subsys blkio
[5847572.618349] Initializing cgroup subsys perf_event
[5847572.618355] Initializing cgroup subsys hugetlb
[5847572.618436] CPU: Physical Processor ID: 0
[5847572.618442] CPU: Processor Core ID: 6
[5847572.618451] Last level iTLB entries: 4KB 512, 2MB 0, 4MB 0
[5847572.618451] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32
[5847572.618451] tlb_flushall_shift: 5
[5847572.713974] Freeing SMP alternatives memory: 32K (ffffffff81e6e000 - ffffffff81e76000)
[5847572.716055] ftrace: allocating 28541 entries in 112 pages
[5847572.736567] cpu 0 spinlock event irq 17
[5847572.750216] Performance Events: unsupported p6 CPU model 45 no PMU driver, software events only.
[5847572.752183] x86: Booted up 1 node, 1 CPUs
[5847572.752266] NMI watchdog: disabled (cpu0): hardware events not enabled
[5847572.752374] devtmpfs: initialized
[5847572.755655] EVM: security.selinux
[5847572.755663] EVM: security.SMACK64
[5847572.755669] EVM: security.ima
[5847572.755674] EVM: security.capability
[5847572.756807] pinctrl core: initialized pinctrl subsystem
[5847572.756847] xen:grant_table: Grant tables using version 1 layout
[5847572.756864] Grant table initialized
[5847572.756917] regulator-dummy: no parameters
[5847572.776798] RTC time: 165:165:165, date: 165/165/65
[5847572.776858] NET: Registered protocol family 16
[5847572.778022] PCI: setting up Xen PCI frontend stub
[5847572.778030] PCI: pci_cache_line_size set to 64 bytes
[5847572.778952] bio: create slab <bio-0> at 0
[5847572.779110] ACPI: Interpreter disabled.
[5847572.779125] xen:balloon: Initialising balloon driver
[5847572.780134] xen_balloon: Initialising balloon driver
[5847572.780350] vgaarb: loaded
[5847572.780583] SCSI subsystem initialized
[5847572.780632] libata version 3.00 loaded.
[5847572.780685] usbcore: registered new interface driver usbfs
[5847572.780704] usbcore: registered new interface driver hub
[5847572.780733] usbcore: registered new device driver usb
[5847572.780858] PCI: System does not support PCI
[5847572.780866] PCI: System does not support PCI
[5847572.780966] NetLabel: Initializing
[5847572.780973] NetLabel:  domain hash size = 128
[5847572.780977] NetLabel:  protocols = UNLABELED CIPSOv4
[5847572.781000] NetLabel:  unlabeled traffic allowed by default
[5847572.781089] Switched to clocksource xen
[5847572.786884] AppArmor: AppArmor Filesystem Enabled
[5847572.786911] pnp: PnP ACPI: disabled
[5847572.788525] NET: Registered protocol family 2
[5847572.788748] TCP established hash table entries: 8192 (order: 4, 65536 bytes)
[5847572.788821] TCP bind hash table entries: 8192 (order: 5, 131072 bytes)
[5847572.788857] TCP: Hash tables configured (established 8192 bind 8192)
[5847572.788904] TCP: reno registered
[5847572.788916] UDP hash table entries: 512 (order: 2, 16384 bytes)
[5847572.788929] UDP-Lite hash table entries: 512 (order: 2, 16384 bytes)
[5847572.789003] NET: Registered protocol family 1
[5847572.789015] PCI: CLS 0 bytes, default 64
[5847572.789131] Trying to unpack rootfs image as initramfs...
[5847572.817599] Freeing initrd memory: 20828K (ffff880002403000 - ffff88000385a000)
[5847572.817783] platform rtc_cmos: registered platform RTC device (no PNP device found)
[5847572.817878] microcode: CPU0 sig=0x206d7, pf=0x1, revision=0x70b
[5847572.817945] microcode: Microcode Update Driver: v2.00 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[5847572.817953] Scanning for low memory corruption every 60 seconds
[5847572.818258] Initialise system trusted keyring
[5847572.818324] audit: initializing netlink socket (disabled)
[5847572.818346] type=2000 audit(1412870558.823:1): initialized
[5847572.852800] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[5847572.853901] zbud: loaded
[5847572.854092] VFS: Disk quotas dquot_6.5.2
[5847572.854151] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[5847572.854691] fuse init (API version 7.22)
[5847572.854786] msgmni has been set to 1171
[5847572.854855] Key type big_key registered
[5847572.855150] Key type asymmetric registered
[5847572.855156] Asymmetric key parser 'x509' registered
[5847572.855198] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 252)
[5847572.855238] io scheduler noop registered
[5847572.855243] io scheduler deadline registered (default)
[5847572.855276] io scheduler cfq registered
[5847572.855340] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[5847572.855361] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[5847572.855412] intel_idle: does not run on family 6 model 45
[5847572.855419] ipmi message handler version 39.2
[5847572.942641] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[5847572.943882] Linux agpgart interface v0.103
[5847572.945332] brd: module loaded
[5847572.946053] loop: module loaded
[5847572.955200] libphy: Fixed MDIO Bus: probed
[5847572.955305] tun: Universal TUN/TAP device driver, 1.6
[5847572.955310] tun: (C) 1999-2004 Max Krasnyansky <maxk@qualcomm.com>
[5847572.955366] PPP generic driver version 2.4.2
[5847572.955412] xen_netfront: Initialising Xen virtual ethernet driver
[5847572.956057] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[5847572.956071] ehci-pci: EHCI PCI platform driver
[5847572.956097] ehci-platform: EHCI generic platform driver
[5847572.956115] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[5847572.956125] ohci-pci: OHCI PCI platform driver
[5847572.956158] ohci-platform: OHCI generic platform driver
[5847572.956169] uhci_hcd: USB Universal Host Controller Interface driver
[5847572.956243] i8042: PNP: No PS/2 controller found. Probing ports directly.
[5847573.962167] i8042: No controller found
[5847573.962517] mousedev: PS/2 mouse device common for all mice
[5847574.022407] rtc_cmos rtc_cmos: rtc core: registered rtc_cmos as rtc0
[5847574.022510] rtc_cmos: probe of rtc_cmos failed with error -38
[5847574.022622] device-mapper: uevent: version 1.0.3
[5847574.022718] device-mapper: ioctl: 4.27.0-ioctl (2013-10-30) initialised: dm-devel@redhat.com
[5847574.022732] ledtrig-cpu: registered to indicate activity on CPUs
[5847574.022873] TCP: cubic registered
[5847574.022980] NET: Registered protocol family 10
[5847574.023242] NET: Registered protocol family 17
[5847574.023260] Key type dns_resolver registered
[5847574.023403] Loading compiled-in X.509 certificates
[5847574.024635] Loaded X.509 cert 'Magrathea: Glacier signing key: 2cb1133b35f95a9e24deabeeb12ba449bcbabbc9'
[5847574.024663] registered taskstats version 1
[5847574.028996] Key type trusted registered
[5847574.032915] Key type encrypted registered
[5847574.036832] AppArmor: AppArmor sha1 policy hashing enabled
[5847574.036845] IMA: No TPM chip found, activating TPM-bypass!
[5847574.069849] blkfront: xvda1: barrier or flush: disabled; persistent grants: disabled; indirect descriptors: disabled;
[5847574.133182] regulator-dummy: incomplete constraints, leaving on
[5847574.133307]   Magic number: 1:252:3141
[5847574.133376] /build/buildd/linux-3.13.0/drivers/rtc/hctosys.c: unable to open rtc device (rtc0)
[5847574.133478] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found
[5847574.133489] EDD information not available.
[5847574.133529] PM: Hibernation image not present or could not be loaded.
[5847574.134866] Freeing unused kernel memory: 1336K (ffffffff81d20000 - ffffffff81e6e000)
[5847574.134882] Write protecting the kernel read-only data: 12288k
[5847574.140633] Freeing unused kernel memory: 804K (ffff880001737000 - ffff880001800000)
[5847574.141144] Freeing unused kernel memory: 692K (ffff880001b53000 - ffff880001c00000)
[5847574.184846] systemd-udevd[94]: starting version 204
[5847575.506050] EXT4-fs (xvda1): INFO: recovery required on readonly filesystem
[5847575.506061] EXT4-fs (xvda1): write access will be enabled during recovery
[5847576.068638] EXT4-fs (xvda1): recovery complete
[5847576.072288] EXT4-fs (xvda1): mounted filesystem with ordered data mode. Opts: (null)
[5847576.421464] random: init urandom read with 124 bits of entropy available
[5847576.503515] random: nonblocking pool is initialized
[5847576.956506] EXT4-fs (xvda1): re-mounted. Opts: discard
[5847578.952691] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[5847579.191057] systemd-udevd[419]: starting version 204
[5847579.594836] type=1400 audit(1412870565.595:2): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/sbin/dhclient" pid=454 comm="apparmor_parser"
[5847579.594848] type=1400 audit(1412870565.595:3): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=454 comm="apparmor_parser"
[5847579.594854] type=1400 audit(1412870565.595:4): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/connman/scripts/dhclient-script" pid=454 comm="apparmor_parser"
[5847579.595431] type=1400 audit(1412870565.595:5): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=454 comm="apparmor_parser"
[5847579.595439] type=1400 audit(1412870565.595:6): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="/usr/lib/connman/scripts/dhclient-script" pid=454 comm="apparmor_parser"
[5847579.595743] type=1400 audit(1412870565.595:7): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="/usr/lib/connman/scripts/dhclient-script" pid=454 comm="apparmor_parser"
[5847579.610347] type=1400 audit(1412870565.611:8): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/sbin/ntpd" pid=459 comm="apparmor_parser"
[5847580.024633] init: rpcbind main process (516) terminated with status 127
[5847580.024659] init: rpcbind main process ended, respawning
[5847580.078459] init: Failed to obtain startpar-bridge instance: Unknown parameter: INSTANCE
[5847616.095881] init: zabbix-agent pre-start process (769) terminated with status 1
[5847616.233231] init: failsafe main process (764) killed by TERM signal
[5847617.055350] type=1400 audit(1412870603.055:9): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="/sbin/dhclient" pid=940 comm="apparmor_parser"
[5847617.055362] type=1400 audit(1412870603.055:10): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=940 comm="apparmor_parser"
[5847617.055369] type=1400 audit(1412870603.055:11): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="/usr/lib/connman/scripts/dhclient-script" pid=940 comm="apparmor_parser"
[5847617.055942] type=1400 audit(1412870603.055:12): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=940 comm="apparmor_parser"
[5847617.055948] type=1400 audit(1412870603.055:13): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="/usr/lib/connman/scripts/dhclient-script" pid=940 comm="apparmor_parser"
[5847617.056242] type=1400 audit(1412870603.055:14): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="/usr/lib/connman/scripts/dhclient-script" pid=940 comm="apparmor_parser"
[5847617.072142] type=1400 audit(1412870603.071:15): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/namecoind-safe" pid=941 comm="apparmor_parser"
[5847617.085377] type=1400 audit(1412870603.087:16): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/sbin/mysqld" pid=942 comm="apparmor_parser"
[5847617.095225] type=1400 audit(1412870603.095:17): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="/usr/sbin/ntpd" pid=943 comm="apparmor_parser"
[5847617.115043] type=1400 audit(1412870603.115:18): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/sbin/tcpdump" pid=947 comm="apparmor_parser"
[5847650.855550] init: plymouth-upstart-bridge main process ended, respawning

Offline xeroc

  • Board Moderator
  • Hero Member
  • *****
  • Posts: 12922
  • ChainSquad GmbH
    • View Profile
    • ChainSquad GmbH
  • BitShares: xeroc
  • GitHub: xeroc
run "dmesg" in the console .. I am almost sure that your kernel killed the client due to insufficient RAM!

if so you can add a swap file for "ram on the hdd": http://www.cyberciti.biz/faq/linux-add-a-swap-file-howto/

Offline dannotestein

  • Hero Member
  • *****
  • Posts: 760
    • View Profile
    • BlockTrades International
  • BitShares: btsnow
Code: [Select]
ulimit -a
core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 0
file size               (blocks, -f) unlimited
pending signals                 (-i) 4523
max locked memory       (kbytes, -l) 64
max memory size         (kbytes, -m) unlimited
open files                      (-n) 1024
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 8192
cpu time               (seconds, -t) unlimited
max user processes              (-u) 4523
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited
That looks reasonable to me at first glance.
http://blocktrades.us Fast/Safe/High-Liquidity Crypto Coin Converter

Offline FuLl

  • Full Member
  • ***
  • Posts: 101
    • View Profile
Code: [Select]
ulimit -a
core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 0
file size               (blocks, -f) unlimited
pending signals                 (-i) 4523
max locked memory       (kbytes, -l) 64
max memory size         (kbytes, -m) unlimited
open files                      (-n) 1024
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 8192
cpu time               (seconds, -t) unlimited
max user processes              (-u) 4523
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited

Offline dannotestein

  • Hero Member
  • *****
  • Posts: 760
    • View Profile
    • BlockTrades International
  • BitShares: btsnow
It just crashed using the github version. This is the output from gdb:

Code: [Select]
(wallet closed) >>> [Thread 0x7fffd0ff9700 (LWP 6502) exited]
[Thread 0x7fffd17fa700 (LWP 6501) exited]
[Thread 0x7fffd1ffb700 (LWP 6500) exited]
[Thread 0x7fffd27fc700 (LWP 6499) exited]
[Thread 0x7fffd2ffd700 (LWP 6498) exited]
[Thread 0x7fffd37fe700 (LWP 6497) exited]
[Thread 0x7fffd3fff700 (LWP 6496) exited]
[Thread 0x7fffe48f0700 (LWP 6495) exited]
[Thread 0x7fffe50f1700 (LWP 6494) exited]
[Thread 0x7fffe60ea700 (LWP 6493) exited]
[Thread 0x7fffe6ffd700 (LWP 6492) exited]
[Thread 0x7fffe77fe700 (LWP 6491) exited]
[Thread 0x7fffe7fff700 (LWP 6490) exited]
[Thread 0x7ffff4bc8700 (LWP 6489) exited]
[Thread 0x7ffff53c9700 (LWP 6488) exited]
[Thread 0x7ffff5bca700 (LWP 6487) exited]
[Thread 0x7ffff63cb700 (LWP 6486) exited]
Program terminated with signal SIGKILL, Killed.
The program no longer exists.

I didn't do that.

How do I get something useful to report for debugging?
Apparently the program was killed somehow, so you won't be able to get a backtrace.

I looked at your p2p log, looks like normal messages there (message about disconnections are quite common and destroying peer connection objects for those connection is normal behavior). The underlying fc library used by bitsharesx client throws exceptions to indicate a socket has been closed by the peer you're communicating with.

The interesting question is how the program was killed, maybe you're hitting a ulimit on your system that is terminating the client. Can you type "ulimit -a" and post the output of that command?
http://blocktrades.us Fast/Safe/High-Liquidity Crypto Coin Converter

Offline FuLl

  • Full Member
  • ***
  • Posts: 101
    • View Profile
It just crashed using the github version. This is the output from gdb:

Code: [Select]
(wallet closed) >>> [Thread 0x7fffd0ff9700 (LWP 6502) exited]
[Thread 0x7fffd17fa700 (LWP 6501) exited]
[Thread 0x7fffd1ffb700 (LWP 6500) exited]
[Thread 0x7fffd27fc700 (LWP 6499) exited]
[Thread 0x7fffd2ffd700 (LWP 6498) exited]
[Thread 0x7fffd37fe700 (LWP 6497) exited]
[Thread 0x7fffd3fff700 (LWP 6496) exited]
[Thread 0x7fffe48f0700 (LWP 6495) exited]
[Thread 0x7fffe50f1700 (LWP 6494) exited]
[Thread 0x7fffe60ea700 (LWP 6493) exited]
[Thread 0x7fffe6ffd700 (LWP 6492) exited]
[Thread 0x7fffe77fe700 (LWP 6491) exited]
[Thread 0x7fffe7fff700 (LWP 6490) exited]
[Thread 0x7ffff4bc8700 (LWP 6489) exited]
[Thread 0x7ffff53c9700 (LWP 6488) exited]
[Thread 0x7ffff5bca700 (LWP 6487) exited]
[Thread 0x7ffff63cb700 (LWP 6486) exited]
Program terminated with signal SIGKILL, Killed.
The program no longer exists.

I didn't do that.

How do I get something useful to report for debugging?

Offline FuLl

  • Full Member
  • ***
  • Posts: 101
    • View Profile
I'm running the PPA binary on a few machines, and haven't seen this yet. You said it "still" won't stay running, did it ever work before (a different version maybe?) Do you have any other PPAs enabled? It looks like it's crashing when trying to connect to a peer, maybe one of the networking libraries is from a different PPA?
Got it to run by typing 'run'. I didn't know that needed to happen.

30 minutes or so now & it's still up, so I'm thinking you might be right about the ppa issue with libraries or something. It _did_ run back at version 0.4.18- started crashing at 0.4.19. Back then I was using kernel x-29 & I don't know if that since yesterday I'm at x-37 now that might be why. I'll test that soon.

If I have further issues, I'll just keep using github's version since it isn't crashing.

Just a s3fs-fuse ppa enabled by the way.
« Last Edit: October 09, 2014, 03:37:47 pm by FuLl »

Offline maqifrnswa

  • Hero Member
  • *****
  • Posts: 661
    • View Profile
I'm running the PPA binary on a few machines, and haven't seen this yet. You said it "still" won't stay running, did it ever work before (a different version maybe?) Do you have any other PPAs enabled? It looks like it's crashing when trying to connect to a peer, maybe one of the networking libraries is from a different PPA?
maintains an Ubuntu PPA: https://launchpad.net/~showard314/+archive/ubuntu/bitshares [15% delegate] wallet_account_set_approval maqifrnswa true [50% delegate] wallet_account_set_approval delegate1.maqifrnswa true

Offline dannotestein

  • Hero Member
  • *****
  • Posts: 760
    • View Profile
    • BlockTrades International
  • BitShares: btsnow
I ran it in the debugger, maybe it's still running, as there's my 'gdb...' command still in htop.

After 10 minutes or so I got the (gdb) prompt in my console:

Code: [Select]
Reading symbols from /home/ubuntu/BitSharesX/bitshares_toolkit/programs/client/bitshares_client...done.
(gdb)

Have you typed "run" in gdb to start the process yet?
http://blocktrades.us Fast/Safe/High-Liquidity Crypto Coin Converter

Offline FuLl

  • Full Member
  • ***
  • Posts: 101
    • View Profile
I ran it in the debugger, maybe it's still running, as there's my 'gdb...' command still in htop.

After 10 minutes or so I got the (gdb) prompt in my console:

Code: [Select]
Reading symbols from /home/ubuntu/BitSharesX/bitshares_toolkit/programs/client/bitshares_client...done.
(gdb)

I don't know if that's because it finally crashed or not, as I said, the gdb command's still present in htop.

Not sure what to do next- I don't see the command I'm used to seeing when the daemon is running: 'bltsharesx-cli --daemon' in htop, never have yet.

Not even sure the start then crash ever happened being that I didn't see that command appear.

I don't know if it might be necessary for someone else to try to recreate the problem on a VM or something, I'm running Ubuntu 12.04 with kernel 3.13.0-37-generic.

I do know that since I got to the (gdb) prompt, mysql has crashed & won't start again. I'm hesitant to reboot since I don't know if the daemon might actually be running & I ought to wait for it to crash again to debug it right.

Please advise.

Offline xeroc

  • Board Moderator
  • Hero Member
  • *****
  • Posts: 12922
  • ChainSquad GmbH
    • View Profile
    • ChainSquad GmbH
  • BitShares: xeroc
  • GitHub: xeroc
No, it's from the Ubuntu ppa.

Give me some time & I'll try the one from git so it'll debug.
https://github.com/dacsunlimited/bitsharesx/blob/master/BUILD_UBUNTU.md

Quote
I keep the config.json because I was under the impression I needed the rpc configuration set to run as a seed node. Is this not correct?
nop .. no rpc required for seed nodes .. just a running node on the default (optional) port

Offline FuLl

  • Full Member
  • ***
  • Posts: 101
    • View Profile
No, it's from the Ubuntu ppa.

Give me some time & I'll try the one from git so it'll debug.

----

I keep the config.json because I was under the impression I needed the rpc configuration set to run as a seed node. Is this not correct?

Offline xeroc

  • Board Moderator
  • Hero Member
  • *****
  • Posts: 12922
  • ChainSquad GmbH
    • View Profile
    • ChainSquad GmbH
  • BitShares: xeroc
  • GitHub: xeroc
I get this from gdb:

Code: [Select]
Reading symbols from bitshares_client...(no debugging symbols found)...done.
(gdb)

...And I don't see the client process show up in htop.

But it starts if I don't use gdb before the plain 'bitshares_client' command.
oh ... your bitshares client is "stripped" .. no debug information in it .. so that want work .. you compiled it your self?

Offline FuLl

  • Full Member
  • ***
  • Posts: 101
    • View Profile
I get this from gdb:

Code: [Select]
Reading symbols from bitshares_client...(no debugging symbols found)...done.
(gdb)

...And I don't see the client process show up in htop.

But it starts if I don't use gdb before the plain 'bitshares_client' command.

Offline xeroc

  • Board Moderator
  • Hero Member
  • *****
  • Posts: 12922
  • ChainSquad GmbH
    • View Profile
    • ChainSquad GmbH
  • BitShares: xeroc
  • GitHub: xeroc
2) could you run the client in "gdb" so that you get a backtrace once the client crashes?

What's the right way to do that?

When I do:
Code: [Select]
$sudo gdb bitshares_client --daemon...gdb complains about the unrecognized --daemon flag.

And when I do:
Code: [Select]
$sudo gdb 'bitshares_client --daemon'...It doesn't start.

Am I starting it wrong maybe?

just leave the daemon flag away ..


if there is a promt and nothing happening type "run"

Offline FuLl

  • Full Member
  • ***
  • Posts: 101
    • View Profile
2) could you run the client in "gdb" so that you get a backtrace once the client crashes?

What's the right way to do that?

When I do:
Code: [Select]
$sudo gdb bitshares_client --daemon...gdb complains about the unrecognized --daemon flag.

And when I do:
Code: [Select]
$sudo gdb 'bitshares_client --daemon'...It doesn't start.

Am I starting it wrong maybe?

Offline xeroc

  • Board Moderator
  • Hero Member
  • *****
  • Posts: 12922
  • ChainSquad GmbH
    • View Profile
    • ChainSquad GmbH
  • BitShares: xeroc
  • GitHub: xeroc
1) why are you keeping the config.json? there is nothing of value in it! .. the folder "wallet" is valuable and you should always make a backup of it (or use the inapp backup function)
2) could you run the client in "gdb" so that you get a backtrace once the client crashes?

Offline FuLl

  • Full Member
  • ***
  • Posts: 101
    • View Profile
Hi,

I've upgraded from 0.4.19 to the 0.4.20+a version in the Ubuntu ppa, & it still won't stay running on my box.

I tried deleting everything in the .BitSharesX directory except config.json to no avail, it'll stay running for a little while then die.

I see problems in p2p.log that seem ominous, & suspect that's the problem, but I'm no expert so I'm posting here for help.

p2p.log:

Code: [Select]
20141009T090425.968249     ntp:ntp_read_loop          request_now ] resolving... ["pool.ntp.org",123] ntp.cpp:55
20141009T090426.216655     ntp:ntp_read_loop          request_now ] sending request to 108.61.73.243:123 ntp.cpp:59
20141009T090426.225183     ntp:ntp_read_loop            read_loop ] received ntp reply from 108.61.73.243:123 ntp.cpp:120
20141009T090426.225258     ntp:ntp_read_loop            read_loop ] ntp_delta_time updated to -71311 ntp.cpp:145
20141009T090427.205787        th_a:?unnamed?        open_database ] old database version, upgrade and re-sync chain_database.cpp:105
20141009T090430.725502        th_a:?unnamed?                 open ] loading pending trx... chain_database.cpp:1074
20141009T090438.922354   upnp:upnp::map_port           operator() ] No valid UPnP IGDs found upnp.cpp:157
20141009T090443.881835 th_a:rebroadcast_pending rebroadcast_pending_ ]  rebroadcasting... client.cpp:1102
20141009T090443.933725   p2p:connect_to_task           connect_to ] fatal: error connecting to peer 104.131.35.149:1776: 0 exception: unspecified
Connection refused
    {"message":"Connection refused"}
    asio  asio.cpp:59 error_handler peer_connection.cpp:204
20141009T090443.935878 p2p:delayed_peer_deletion_task              destroy ] Unexpected exception from peer_connection's accept_or_connect_task : {"code":0,"name":"exception","message":"unspecified","stack":[{"context":{"level":"error","file":"asio.cpp","line":59,"method":"error_handler","hostname":"","thread_name":"asio","timestamp":"20141009T090443.928942"},"format":"${message} ","data":{"message":"Connection refused"}}]} peer_connection.cpp:107
20141009T090444.006358   p2p:connect_to_task           connect_to ] fatal: error connecting to peer 54.77.51.177:1776: 0 exception: unspecified
Connection refused
    {"message":"Connection refused"}
    asio  asio.cpp:59 error_handler peer_connection.cpp:204
20141009T090444.006686 p2p:delayed_peer_deletion_task              destroy ] Unexpected exception from peer_connection's accept_or_connect_task : {"code":0,"name":"exception","message":"unspecified","stack":[{"context":{"level":"error","file":"asio.cpp","line":59,"method":"error_handler","hostname":"","thread_name":"asio","timestamp":"20141009T090444.005917"},"format":"${message} ","data":{"message":"Connection refused"}}]} peer_connection.cpp:107
20141009T090444.013204   p2p:connect_to_task           connect_to ] fatal: error connecting to peer 5.101.106.138:1777: 0 exception: unspecified
Connection refused
    {"message":"Connection refused"}
    asio  asio.cpp:59 error_handler peer_connection.cpp:204
20141009T090444.013430 p2p:delayed_peer_deletion_task              destroy ] Unexpected exception from peer_connection's accept_or_connect_task : {"code":0,"name":"exception","message":"unspecified","stack":[{"context":{"level":"error","file":"asio.cpp","line":59,"method":"error_handler","hostname":"","thread_name":"asio","timestamp":"20141009T090444.013086"},"format":"${message} ","data":{"message":"Connection refused"}}]} peer_connection.cpp:107
20141009T090444.017498   p2p:connect_to_task           connect_to ] fatal: error connecting to peer 178.62.157.161:1776: 0 exception: unspecified
Connection refused
    {"message":"Connection refused"}
    asio  asio.cpp:59 error_handler peer_connection.cpp:204
20141009T090444.017694 p2p:delayed_peer_deletion_task              destroy ] Unexpected exception from peer_connection's accept_or_connect_task : {"code":0,"name":"exception","message":"unspecified","stack":[{"context":{"level":"error","file":"asio.cpp","line":59,"method":"error_handler","hostname":"","thread_name":"asio","timestamp":"20141009T090444.016865"},"format":"${message} ","data":{"message":"Connection refused"}}]} peer_connection.cpp:107
20141009T090444.151510   p2p:connect_to_task           connect_to ] fatal: error connecting to peer 61.129.33.213:1776: 0 exception: unspecified
Connection refused
    {"message":"Connection refused"}
    asio  asio.cpp:59 error_handler peer_connection.cpp:204
20141009T090444.151857 p2p:delayed_peer_deletion_task              destroy ] Unexpected exception from peer_connection's accept_or_connect_task : {"code":0,"name":"exception","message":"unspecified","stack":[{"context":{"level":"error","file":"asio.cpp","line":59,"method":"error_handler","hostname":"","thread_name":"asio","timestamp":"20141009T090444.150642"},"format":"${message} ","data":{"message":"Connection refused"}}]} peer_connection.cpp:107
20141009T090444.179158   p2p:connect_to_task           connect_to ] fatal: error connecting to peer 54.79.27.224:1776: 0 exception: unspecified
Connection refused
    {"message":"Connection refused"}
    asio  asio.cpp:59 error_handler peer_connection.cpp:204
20141009T090444.179484 p2p:delayed_peer_deletion_task              destroy ] Unexpected exception from peer_connection's accept_or_connect_task : {"code":0,"name":"exception","message":"unspecified","stack":[{"context":{"level":"error","file":"asio.cpp","line":59,"method":"error_handler","hostname":"","thread_name":"asio","timestamp":"20141009T090444.179038"},"format":"${message} ","data":{"message":"Connection refused"}}]} peer_connection.cpp:107
20141009T090445.557016 p2p:message read_loop on_closing_connectio ] Peer 180.153.142.120:1777 is disconnecting us because: I rejected your connection request (hello message) so I'm disconnecting node.cpp:2501
20141009T090445.610143 p2p:message read_loop            read_loop ] disconnected 0 exception: unspecified
Bad file descriptor
    {"message":"Bad file descriptor"}
    asio  asio.cpp:37 operator()

    {"len":16}
    p2p  stcp_socket.cpp:94 readsome message_oriented_connection.cpp:182
20141009T090445.610351 p2p:delayed_peer_deletion_task   destroy_connection ] Exception thrown while canceling message_oriented_connection's read_loop, ignoring: {"code":0,"name":"exception","message":"unspecified","stack":[{"context":{"level":"warn","file":"message_oriented_connection.cpp","line":184,"method":"read_loop","hostname":"","thread_name":"p2p","timestamp":"20141009T090445.610207"},"format":"disconnected: ${e}","data":{"e":"0 exception: unspecified\nBad file descriptor \n    {\"message\":\"Bad file descriptor\"}\n    asio  asio.cpp:37 operator()\n\n    {\"len\":16}\n    p2p  stcp_socket.cpp:94 readsome"}}]} message_oriented_connection.cpp:274
20141009T090445.610453 p2p:delayed_peer_deletion_task   destroy_connection ] Exception thrown while canceling message_oriented_connection's read_loop, ignoring: {"code":0,"name":"exception","message":"unspecified","stack":[{"context":{"level":"warn","file":"message_oriented_connection.cpp","line":184,"method":"read_loop","hostname":"","thread_name":"p2p","timestamp":"20141009T090445.610207"},"format":"disconnected: ${e}","data":{"e":"0 exception: unspecified\nBad file descriptor \n    {\"message\":\"Bad file descriptor\"}\n    asio  asio.cpp:37 operator()\n\n    {\"len\":16}\n    p2p  stcp_socket.cpp:94 readsome"}}]} message_oriented_connection.cpp:274
20141009T090449.919339 p2p:terminate_inactive_connections_loop terminate_inactive_c ] Forcibly disconnecting from handshaking peer 89.187.144.203:8764 due to inactivity of at least 5 seconds node.cpp:1193
20141009T090449.919404 p2p:terminate_inactive_connections_loop terminate_inactive_c ] Peer's negotiating status: connecting, bytes sent: 0, bytes received: 0 node.cpp:1197
20141009T090449.919446 p2p:terminate_inactive_connections_loop terminate_inactive_c ] Forcibly disconnecting from handshaking peer 188.226.195.137:60696 due to inactivity of at least 5 seconds node.cpp:1193
20141009T090449.919471 p2p:terminate_inactive_connections_loop terminate_inactive_c ] Peer's negotiating status: connecting, bytes sent: 0, bytes received: 0 node.cpp:1197
20141009T090449.920938   p2p:connect_to_task           connect_to ] fatal: error connecting to peer 188.226.195.137:60696: 0 exception: unspecified
Operation canceled
    {"message":"Operation canceled"}
    asio  asio.cpp:59 error_handler peer_connection.cpp:204
20141009T090449.921141 p2p:delayed_peer_deletion_task              destroy ] Unexpected exception from peer_connection's accept_or_connect_task : {"code":0,"name":"exception","message":"unspecified","stack":[{"context":{"level":"error","file":"asio.cpp","line":59,"method":"error_handler","hostname":"","thread_name":"asio","timestamp":"20141009T090449.920455"},"format":"${message} ","data":{"message":"Operation canceled"}}]}

default.log:

Code: [Select]
20141009T090425.968249     ntp:ntp_read_loop          request_now ] resolving... ["pool.ntp.org",123] ntp.cpp:55
20141009T090426.216655     ntp:ntp_read_loop          request_now ] sending request to 108.61.73.243:123 ntp.cpp:59
20141009T090426.225183     ntp:ntp_read_loop            read_loop ] received ntp reply from 108.61.73.243:123 ntp.cpp:120
20141009T090426.225258     ntp:ntp_read_loop            read_loop ] ntp_delta_time updated to -71311 ntp.cpp:145
20141009T090427.205787        th_a:?unnamed?        open_database ] old database version, upgrade and re-sync chain_database.cpp:105
20141009T090430.725502        th_a:?unnamed?                 open ] loading pending trx... chain_database.cpp:1074
20141009T090438.922354   upnp:upnp::map_port           operator() ] No valid UPnP IGDs found upnp.cpp:157
20141009T090443.881835 th_a:rebroadcast_pending rebroadcast_pending_ ]  rebroadcasting... client.cpp:1102
20141009T090456.885002 th_a:rebroadcast_pending rebroadcast_pending_ ]  rebroadcasting... client.cpp:1102
20141009T090509.892257 th_a:rebroadcast_pending rebroadcast_pending_ ]  rebroadcasting... client.cpp:1102
20141009T090522.892461 th_a:rebroadcast_pending rebroadcast_pending_ ]  rebroadcasting... client.cpp:1102
20141009T090535.894387 th_a:rebroadcast_pending rebroadcast_pending_ ]  rebroadcasting... client.cpp:1102
20141009T090548.895160 th_a:rebroadcast_pending rebroadcast_pending_ ]  rebroadcasting... client.cpp:1102
20141009T090601.897461 th_a:rebroadcast_pending rebroadcast_pending_ ]  rebroadcasting... client.cpp:1102
20141009T090614.897692 th_a:rebroadcast_pending rebroadcast_pending_ ]  rebroadcasting... client.cpp:1102
20141009T090627.901372 th_a:rebroadcast_pending rebroadcast_pending_ ]  rebroadcasting... client.cpp:1102
20141009T090640.903119 th_a:rebroadcast_pending rebroadcast_pending_ ]  rebroadcasting... client.cpp:1102
20141009T090653.903355 th_a:rebroadcast_pending rebroadcast_pending_ ] skip rebroadcast_pending while syncing client.cpp:1098
20141009T090706.904391 th_a:rebroadcast_pending rebroadcast_pending_ ] skip rebroadcast_pending while syncing client.cpp:1098
20141009T090719.924230 th_a:rebroadcast_pending rebroadcast_pending_ ] skip rebroadcast_pending while syncing client.cpp:1098
20141009T090733.227063 th_a:rebroadcast_pending rebroadcast_pending_ ] skip rebroadcast_pending while syncing client.cpp:1098

Would someone kindly interpret this for me & provide some guidance?

Thanks,

-F