Hi,
I need help, Im workin with 30,000,000 rows in Asociation Rules algorithm, but, when process the model, it fail for memory problem.
PLEASE help me
Charlie
Hello, CharlieHere are a few suggestions that would reduce the memory pressure on the server:
- Increase the value of the MINIMUM_SUPPORT parameter. The default (0.03) value requires a group of items to appear in at least 3% of the transactions to be considered for the left hand side of a rule. By increasing it, the algorithm will analyze fewer items
- Decrease the MAXIMUM_ITEMSET_COUNT parameter.
- Decrease the value of MAXIMUM_ITEMSET_SIZE or increase the value of MINIMUM_ITEMSET_SIZE. If shorter rules correlating two or three items are OK, then decrease the MAX... parameter (the default value is 3, which generates rules with up to 3 items on the left hand side).
Hope this helps|||
Can you recommended a good source for reading up on tuning Analysis Services and in particular the mining model viewer? Fixing problems is one thing, but I'd also like to build up a good foundation of knowledge.
Thanks,
Nick
|||Hi Bogdan, Thank you!
I reduce the parameters, but this model is important to a supermarket and they dont want reduce some parameters because yours business.
I was reading, Its posible that the problem is support in 32 bits?. The server have 4 procesor and 16 GB of RAM.
Please any suggestion
HELP ME!!
Charlie
|||Carlos, can you post the exact error message that you receive? That may help us to narrow down the issue.
Thanks
|||Are you running the 64 bit or 32 bit version of Analysis Services? With the 32 bit version, the server cannot take advantage of the 16 GB of RAM.
|||Hi,
The Error is : Server Timeout. the procces has been canceled.
umm, There is limit of records in a platform of 32 bits?
The process run for 3 hours and begins to read the cases, when it read the last cases it is when fails.
Thank you for the help!
Charlie
|||
cbdl10 wrote:
Hi,
I need help, Im workin with 30,000,000 rows in Asociation Rules algorithm, but, when process the model, it fail for memory problem.
PLEASE help me
Charlie
hi,
i've got the same problem as yours ..
I can't find a solution yet .. did u?
is it correct considering a MAXIMUM_ITEMSET_COUNT equal to count(*) of my fact table?
[if i reduces my fact table, which means that if i have a fact table working with a 180,000 rows i'll consider only 9,000rows randomly and even in this situation, the algorithm lasts 25min to be accomplished]
|||
cbdl10 wrote:
Hi,
I need help, Im workin with 30,000,000 rows in Asociation Rules algorithm, but, when process the model, it fail for memory problem.
hi there,
i've got the same problem as you ... I'm working with 180,000 records fact table and i've memory problem too (32bit, 2gb ram).
I tried to sample my fact table, by using only 9,000 records randomly chosen but it lasts more or less 25minutes. So, i decided to try to tune algorithm parameters:
MAXIMUM_ITEMSET_COUNT: 9,000;
MAXIMUM_ITEMSET_SIZE: 2;
MINIMU_SUPPORT = 0.1;
It executes very fast, but it doesn't show any result .. does a tuning howto exist? did u solve your problem?
No comments:
Post a Comment