DIY eGPU experiences

[User Retired 2]

Can't remember now, has anyone tried playing around with RPFN settings to get x2 ?
i.e. running "pt MEM write 4 0xYYYYYYYY 0x543210" with different combinations of 0x543210 (0x541230 to make Port 4 into Port 2 and so on)

ICH8M datasheet says in the RPFN description:

Port numbers will remain fixed to a physical root port.
The existing root port Function Disable registers operate on physical ports (not functions).
Port Configuration (1x4, 4x1, etc.) is not affected by the logical function number assignment and is associated with physical ports.

So for x2 mode still need physical port1 and port2 available for connectivity and cannot remap other ports to function in it's place.

The *only* unknown here, for anyone with a desktop system, is what happens when you mask out video card pci-e pins to work only in x4 mode, then mask out say lane 1 and 3. Does it work in x2 mode using lane 2 and 4?
For example, on my DV2000, expresscard=port1, mPCIe=port4.. connecting port1=lane1, port4=lane2 did not work in x2 mode.

If the desktop video card can work in x2 mode using other lanes (1-4), then would need to ask hwtools to re-ignite development of PE4M to allow ports to be connected to allow any available ports (port1-port4) to be connected to lane (1-4), matching their port order.

My last correspondance with hwtools had them announce stopping PE4M development due to customer returns/refunds because of error 12: cannot allocate resources problems that they didn't know what to do about. I asked hwtools to link to this thread off their website.

[toshiki]

It shouldn't be too difficult to make PE4M out of PE4H with the adapter from LinITX.com plugged into it:
http://linitx.com/viewproduct.php?prodid=11773

It is IDE and provides an easy way to solder 2 extra lanes in a shape of mini HDMI sockets or direct soldering to HDMI wires.

[Eye0fHoruS]

Hi there.

Managed to get the power to my GPU and the fans are spinning.

I connect it to the laptop and.. nothing happens. Is there some software I need? Why is windows 7 not picking it up through the express card slot?

Alex

[Eye0fHoruS]

I plugged a mouse into the EC2C adapters USB port and the laptop picks this up. However the 8800 gts remains no where to be picked up. I have disabled the 8800 onboard card on the laptop.

There is no reason for me to suspect the 8800 gts card is damaged. I can check it in another computer if need be.

What are the other areas I should look at?

[JohnnyEM]

Thanks to Nando's help, I'm running in x2 mode on windows 7 with 4 GB System RAM

Now, Everest, GPU-Z and the Nvidia Control Panel all 3 report that I'm running at x2.

With the GeForce GT240 in x1 mode, 4GB RAM I get:

3dMark06=3464
RE5 Benchmark=37.3 fps


In x2 mode, 4GB RAM I get:

3dMark06=5197
RE5 Benchmark=47 fps

It could have been more. I think my 2.0 GHz 667 MHz FSB CPU became the new bottleneck.

[User Retired 2]

UPDATE: DIY Vidock Setup 1.x makes the steps below obsolete . The information below is left as a legacy of the old way of doing things.

Getting > 2.5GB to work in Win7 with PCI Reallocation

PCI Relocation process below can be performed *without* buying/attaching a DIY ViDock.

- ATI cards require 32-bit PCI allocation. Win7 with a 64-bit CPU+chipset using Intel 4500MHD IGP can do the simpler IGP Reallocation instead.

- NVidia cards (9600GT+) can use 64-bit BARS (>4GB) using Win7/32 PAE or Win7/64.

Without a bios allocated 256MB window, the ATI driver will give a error 12:cannot allocate resources in Win7 with > 2.5GB RAM even *after* configuring the underlying PCI bridge, requiring workaround below.

1. There's no free 256MB contiguous window above TOLUD to accomodate the desktop video card. 2. Win7 requires an enabled primary adapter. Cannot disable it then hijaak it's 256MB window like can under XP.

32-bit PCI allocation can only occur above TOLUD to the 4GB boundary (FFFFFFFF). TOLUD, more often than not, cannot be altered as vendor bios lock it by setting D_LCK. See limitram.bat if you want to try anyway. Appears vendors set TOLUD to be mostly 3GB when 4GB is installed, providing 1GB for pci-e configuration space.

DIY ViDock users have so far resorted to removing RAM, which makes TOLUD smaller and frees at least one extra 256MB window. Not an ideal solution.

The Better Solution: PCI Reallocation

Spend 30min-1hr analysing the bios set PCI allocation and then override it with tighter allocation to free up 256MB of space. Performed with 100% success on 3 out of 3 systems below. The analysis of the fourth system, the Dell Studio 1555 found it didn't need reallocation. The fifth system, the Inspiron 14, had a too frugal bios allocated memory map so there isn't room to free 256MB of space.

Steps-by-step instructions

1. Without the desktop video card attached, boot the DIY ViDock USB bootdisk
2. Capture the default pci allocation as a snapshot with 'pcitool /DB:snapshot'
3. Load captured snapshot.bpd into PCI Scope to review the allocation. [Note: PCIScope BSODs on me in Win7, but runs OK in XP]
4. Use Device Manager->View->Resources By Connection->Memory and review PCIScope PCI device configuration data to relocate devices by creating a PCI Reallocation Script. Examples below.
5. Configure the PCI Bridge hosting the desktop video card to use the freed 256MB window.
6. Boot DIY ViDock bootdisk, run PCI Reallocation Script file to tighten up allocation. Run 'grub' to chainload Win7. Enjoy Examples below:

Alternative approach:
1. Run 'pt PCI map' to show your default mapping of devices
2. Run 'lspci -v -xx > pci.txt' to save your PCI configuration
3. Review the pci.txt output, noting the addresses currently occupied, relocating them to another area to free space. Done with the 'setpci -s ' command.

System	RAM	Chipset	PCI Memory Map			Freed 256MB area	PCI Reallocation Script
			TOLUD	Bios Allocated	Reallocated
HP DV2000	3GB	ICH7M	3.00GB	here	here	@3.25GB/D0000000	dv2000pr.bat
HP 2510P^1	2GB	ICH8M	2.00GB	here	here	@3.50GB/E0000000	2510ppr.bat
Acer 9525	4GB	ICH7M	3.00GB	here	here	@3.25GB/D0000000	9525pr.bat
Dell Studio 1555^2	4GB	ICH9M	3.00GB	here	N/A	@3.00GB/C0000000	N/A
Dell Inspiron 1440	4GB	ICH9M	3.50GB	-	N/A	perform the simpler IGP Reallocation

^1 for demonstration purposes only, as don't have a 1x4GB module for it's single slot
^2 - PCI Reallocation not application as it already has a free 256MB window

Disabling onboard graphics?

For further demonstration purposes, and unnecessary after applying the PCI Relocation Script, we see here that by disabling the 2510P's x3100 graphics resources using igp_disb.bat, we could have freed another 256MB @D0000000. This is a shortcut way to free a 256MB window if using XP or Win7-with-XP-video-drivers without desiring a dual-adapter setup. Win7 WDM 1.1 drivers, that provide aero support and DX10, do however require the primary video card active so cannot use this method.

Easier setup?

A request has been gone to a coder to create a DOS based program to run off the DIY VIDock bootdisk to do all this for you. Fingers crossed, we'll see something in the coming weeks.

[JohnnyEM]

Great discovery about the >2.5 GB Ram issue on Windows 7.

Is there a chance the PCI memory reallocation can work for me? The memory allocation structure for my laptop does not seem to be exactly the same.

The PCIScope snapshot was done with the full 4GB ram and without the DIY Vidock connected.

[User Retired 2]

Great discovery about the >2.5 GB Ram issue on Windows 7.

Is there a chance the PCI memory reallocation can work for me? The memory allocation structure for my laptop does not seem to be exactly the same.

The PCIScope snapshot was done with the full 4GB ram and without the DIY Vidock connected.

Since PCI Space is > C0000000 (3GB), your bios has set TOLUD to 3GB. You have devices using D0000000 space that can be moved to F0000000, freeing up the 256MB at D0000000.

I viewed the PCI Config registers of devices that sit in the D0000000 256MB space by loading your snapshot into PCIScope, creating a setpci/batch file to move any address that start with D to a F (ie: Dxxxxxxx -> Fxxxxxxx).

The result is below. Suggest trying initially without attaching your desktop video card. You should just have the PCI Bridge (Port1) at D0000000 shown in Device Manager. Once confirmed, run your x2-conf, then 9525pr.bat, chainload your OS with grub, enjoy

@echo off
::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
:: 9525pr.bat - Acer 9525 PCI Reallocation
::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
:: Free up D0000000(256MB) to then host the desktop video card.
:: on port1 (0/1c/0).
:: 
:: The following setpci commands will only make sense if you viewed
:: alongside the PCI Scope snapshot file and screenshot of MEM map.
::
:: You may get an error on the writes to 0:1c.1, 0:1c.2, 0:1c.3 (port2-4) as 
:: they will disappear when you disable them with your x2-conf

echo [ 9525pr.bat ] Performing PCI Reallocation..
 
setpci -s 0:1.0 20.w=F500
setpci -s 0:1.0 22.w=F6F0

setpci -s 1:0.0 10.l=F6000000
setpci -s 1:0.0 1C.l=F5000004

setpci -s 0:1C.3 20.w=F800
setpci -s 0:1C.3 22.w=F9F0
setpci -s 0:1C.3 24.w=F001
setpci -s 0:1C.3 26.w=F1F1

setpci -s 0:1C.1 20.w=FA00
setpci -s 0:1C.1 22.w=FAF0
setpci -s 0:1C.1 24.w=F301
setpci -s 0:1C.1 26.w=F3F1

setpci -s 0:1C.2 20.w=FB00
setpci -s 0:1C.2 22.w=FBF0
setpci -s 0:1C.2 24.w=F401
setpci -s 0:1C.2 24.w=F4F1

setpci -s 0A:7.0 10.l=FC000000

setpci -s 0:1E.0 20.w=FC00
setpci -s 0:1E.0 22.w=FC00

setpci -s 0A:6.1 10.l=FC015000
setpci -s 0A:6.1 14.l=FC010000

setpci -s 0A:6.2 10.l=FC014000

setpci -s 0A:6.3 10.l=FC015800

setpci -s 0:1D.07 10.l=FC304000

setpci -s 0:1F.02 24.l=FC304400

:: Your x2 port1 is connected to 00:1C:00 bridge.
:: Set it to use the D0000000 (256MB) Window which should be free now.
:: Also Nvidia requires an additional 48MB window which we'll allocate at F0000000 
setpci -s 00:1c.0 1c.w=2020
setpci -s 00:1c.0 20.l=F2FFF000
setpci -s 00:1c.0 24.l=DFF1D001

You're setting the lead with the x2 1.0 link. A HD58xx at x2 1.0 with 4GB RAM would provide some stunning results.

[donis]

Hi ,
Im out of this topic ... and i would like to know
I have one Sony Fw, external monitor, px8800gt video card !
What the best way to make work !

[Pyro515]

I too am having some issues figuring out what to change when doing the reallocation. Also my snapshot.bpd file is showing everything as unknown. Can someone please take a look at these files and give me some guidance? I would appreciate it greatly.

Thanks for your help and time,

Mike