loosing values when load from text file

When loading a table in a data flow from a text file that contains non-null float values, I am seeing erratic and inconsistent results. I am presently using SQL Server Destination in a data flow.

- With low volumnes of data, less that 50,000 rows, no problems

- But with higher volumnes, 2,000,000+ rows, I get different results depending on how I run the package. If I run is directly (right-click and click on Execute), I get the expected result.

But if I use SQL Server Agent to run the package, half of the values are lost and nulls are loaded instead. I have inspected the into text file and there are few rows with null for the column.

Any help would be appreciated!

Greg

>>>- With low volumnes of data, less that 50,000 rows, no problems

Did you have success using both BIDS and SQL Agent for the 50K load?

>>>- But with higher volumnes, 2,000,000+ rows, I get different results depending on how I run the package.

While using SQL Agent did you chose the Command subsystem and use dtexec or the SSIS subsystem?

Loosing text format in pdf-Export

Hi NG,
in my report (html-view) i got the following value (i.e) -43.988.224,29 ?
field-type is currency
After export in pdf i got something like that:
0761<; ; 1557/5<#0 ander othe unknown characters.
Any suggests?
frank
www.xax.deAdobe 5.00 and 5.05 do not render symbols (e.g. Euro symbol) correctly when
the Arial font is used. Which version are you using? Did you try other fonts
(e.g. Tahoma)?
--
This posting is provided "AS IS" with no warranties, and confers no rights.
"Frank Matthiesen" <fm@.xax.de> wrote in message
news:34hkssF46ueteU1@.individual.net...
> Hi NG,
> in my report (html-view) i got the following value (i.e) -43.988.224,29 ?
> field-type is currency
> After export in pdf i got something like that:
> 0761<; ; 1557/5<#0 ander othe unknown characters.
> Any suggests?
> frank
> www.xax.de
>sql

Looping through a recordser in a stored procedure

I have a table [myOrders] with three columns. One of the columns
contains text output data [myText] nvarchar(500), one of them contains
a filename [myFileName] nvarchar(50), one of the columns is a bit to
record if it has been output yet[isOutput] bit default value = 0.

I am creating a SQL Agent job that needs to look at a recordset of
[myOrders] where [isOutput] = 0 and create a seperate text file for
each row using [myFileName] as the filename.

Then I need to mark [isOutput] of each record in [myOrders] as 1.

Ok, so that's the task...

What I'm thinking is I construct a stored procedure that starts with a
select statement:

Create PROCEDURE JustDoIt
AS
set nocount on

SELECT
myText, myFileName
FROM
myOrders
WHERE
(isOutput = 0)

THEN I USE BCP to create the file looping through the recordset above.
THIS IS THE PART I AM CLUELESS ABOUT!

/* NEED TO LOOP HERE */

DECLARE @.ReturnCode int
DECLARE @.ExportCommand varchar(255)
DECLARE @.FileName nvarchar(50)
DECLARE @.FileText nvarchar (500)

SELECT @.FileName = myFileName

/*THIS SYNTAX IS PROBABLY TOTALLY OUTA WHACK:)

SET @.ExportCommand =
'BCP @.FileText queryout "c:\' +
@.FileName +
'" -T -c -S ' + @.@.SERVERNAME
EXEC @.ReturnCode = master..xp_cmdshell @.ExportCommand

/* NEED TO EXIT LOOP HERE */

Then I update all records in [myOrders] to 1

BEGIN TRANSACTION

UPDATE
myOrders
SET isOutput = 1
WHERE
(isOutput = 0)

/* err checking here */

COMMIT TRANSACTION

I'm hoping someone can help me construct this.
Thanks,
lqLauren Quantrell (laurenquantrell@.hotmail.com) writes:
> I have a table [myOrders] with three columns. One of the columns
> contains text output data [myText] nvarchar(500), one of them contains
> a filename [myFileName] nvarchar(50), one of the columns is a bit to
> record if it has been output yet[isOutput] bit default value = 0.
> I am creating a SQL Agent job that needs to look at a recordset of
> [myOrders] where [isOutput] = 0 and create a seperate text file for
> each row using [myFileName] as the filename.

I'm glad to see that you are exploring Agent!

Did you ever consider of making it an Active-X job step? You could then
use VBscript for the task, and it may be easier to write files from
VBscript. (Then again, I have never used VB-script myself.) You could
also write a command-line program in whatever language you fancy, and
run the step as as CmdExec.

You could do this in T-SQL, by setting up a cursor, but since you
would have to fork out with xp_cmdshell for BCP for each file, there
may be a performance cost. VBscript (or whatever language) would be
more effective.

The cusror solution is fairly straightforward:

DECLARE your_cur INSENSITIVE CURSOR FOR
> SELECT
> myText, myFileName
, OrderID
> FROM
> myOrders
> WHERE
> (isOutput = 0)

OPEN your_cur

WHILE 1 = 1
BEGIN
FETCH your_cur INTO @.FileText, @.myFileName, @.orderID
IF @.@.fetch_status <> 0
BREAK

> SET @.ExportCommand =
> 'BCP @.FileText queryout "c:\' +
> @.FileName +
> '" -T -c -S ' + @.@.SERVERNAME
> EXEC @.ReturnCode = master..xp_cmdshell @.ExportCommand

IF @.ReturnCode = 0
UPDATE myOrders SET isOutput = 1 WHERE orderID= @.orderID

END

DEALLOCATE your_cur

Now, as it written above, it assumes that @.FileText is a query, but
from your narrative, I believe it is just a file. You could make it
a query by

SELECT @.filetext = 'SELECT ''' + replace(@.filetext, '''', ''') + ''''

--
Erland Sommarskog, SQL Server MVP, esquel@.sommarskog.se

Books Online for SQL Server SP3 at
http://www.microsoft.com/sql/techin.../2000/books.asp|||Erland,
Thanks very much for this code. Hopefully I can construct this from
this foundation.
Question though, can I avoid using cursors by taking advantage of BCP
parameters firstrow, lastrow and batchsize parameters so that I output
one row at a time of a variable row recordset? This would be my
first option.
Thanks,
LQ

Erland Sommarskog <esquel@.sommarskog.se> wrote in message news:<Xns95316883662FYazorman@.127.0.0.1>...
> Lauren Quantrell (laurenquantrell@.hotmail.com) writes:
> > I have a table [myOrders] with three columns. One of the columns
> > contains text output data [myText] nvarchar(500), one of them contains
> > a filename [myFileName] nvarchar(50), one of the columns is a bit to
> > record if it has been output yet[isOutput] bit default value = 0.
> > I am creating a SQL Agent job that needs to look at a recordset of
> > [myOrders] where [isOutput] = 0 and create a seperate text file for
> > each row using [myFileName] as the filename.
> I'm glad to see that you are exploring Agent!
> Did you ever consider of making it an Active-X job step? You could then
> use VBscript for the task, and it may be easier to write files from
> VBscript. (Then again, I have never used VB-script myself.) You could
> also write a command-line program in whatever language you fancy, and
> run the step as as CmdExec.
> You could do this in T-SQL, by setting up a cursor, but since you
> would have to fork out with xp_cmdshell for BCP for each file, there
> may be a performance cost. VBscript (or whatever language) would be
> more effective.
> The cusror solution is fairly straightforward:
> DECLARE your_cur INSENSITIVE CURSOR FOR
> > SELECT
> > myText, myFileName
> , OrderID
> > FROM
> > myOrders
> > WHERE
> > (isOutput = 0)
> OPEN your_cur
> WHILE 1 = 1
> BEGIN
> FETCH your_cur INTO @.FileText, @.myFileName, @.orderID
> IF @.@.fetch_status <> 0
> BREAK
> > SET @.ExportCommand =
> > 'BCP @.FileText queryout "c:\' +
> > @.FileName +
> > '" -T -c -S ' + @.@.SERVERNAME
> > EXEC @.ReturnCode = master..xp_cmdshell @.ExportCommand
> IF @.ReturnCode = 0
> UPDATE myOrders SET isOutput = 1 WHERE orderID= @.orderID
> END
> DEALLOCATE your_cur
> Now, as it written above, it assumes that @.FileText is a query, but
> from your narrative, I believe it is just a file. You could make it
> a query by
> SELECT @.filetext = 'SELECT ''' + replace(@.filetext, '''', ''') + ''''|||Erland, Thanks again for your time.
I want to do this without using a cursor, instead use select top 1 of
the recordset and loop through BCP until there are no more records.

Looks something like

SELECT top1 OrderID, myText, myFileName from tblOrders where isOutput
= 0

>>WHatI need here is to figure out how to extract the value of
myFileName and myText and pass it to the BCP Utility<<

Do until there's no more records in select statement above:

SET @.ExportCommand = 'BCP myText queryout "c:\' + myFileName+ '" -T -c
-S ' + @.@.SERVERNAME
EXEC @.ReturnCode = master..xp_cmdshell @.ExportCommand

UPDATE myOrders SET isOutput = 1 WHERE orderID= @.orderID

Loop

Sorry for being so dumb about this. I have never used this sort of
construction before.

Erland Sommarskog <esquel@.sommarskog.se> wrote in message news:<Xns95316883662FYazorman@.127.0.0.1>...
> Lauren Quantrell (laurenquantrell@.hotmail.com) writes:
> > I have a table [myOrders] with three columns. One of the columns
> > contains text output data [myText] nvarchar(500), one of them contains
> > a filename [myFileName] nvarchar(50), one of the columns is a bit to
> > record if it has been output yet[isOutput] bit default value = 0.
> > I am creating a SQL Agent job that needs to look at a recordset of
> > [myOrders] where [isOutput] = 0 and create a seperate text file for
> > each row using [myFileName] as the filename.
> I'm glad to see that you are exploring Agent!
> Did you ever consider of making it an Active-X job step? You could then
> use VBscript for the task, and it may be easier to write files from
> VBscript. (Then again, I have never used VB-script myself.) You could
> also write a command-line program in whatever language you fancy, and
> run the step as as CmdExec.
> You could do this in T-SQL, by setting up a cursor, but since you
> would have to fork out with xp_cmdshell for BCP for each file, there
> may be a performance cost. VBscript (or whatever language) would be
> more effective.
> The cusror solution is fairly straightforward:
> DECLARE your_cur INSENSITIVE CURSOR FOR
> > SELECT
> > myText, myFileName
> , OrderID
> > FROM
> > myOrders
> > WHERE
> > (isOutput = 0)
> OPEN your_cur
> WHILE 1 = 1
> BEGIN
> FETCH your_cur INTO @.FileText, @.myFileName, @.orderID
> IF @.@.fetch_status <> 0
> BREAK
> > SET @.ExportCommand =
> > 'BCP @.FileText queryout "c:\' +
> > @.FileName +
> > '" -T -c -S ' + @.@.SERVERNAME
> > EXEC @.ReturnCode = master..xp_cmdshell @.ExportCommand
> IF @.ReturnCode = 0
> UPDATE myOrders SET isOutput = 1 WHERE orderID= @.orderID
> END
> DEALLOCATE your_cur
> Now, as it written above, it assumes that @.FileText is a query, but
> from your narrative, I believe it is just a file. You could make it
> a query by
> SELECT @.filetext = 'SELECT ''' + replace(@.filetext, '''', ''') + ''''|||I realize there is a cost to using cursors, but since you're going
to launch the command shell for BCP on every record, the cost of the
cursor is probably insignificant. But if you insist...

> Erland, Thanks again for your time.
> I want to do this without using a cursor, instead use select top 1 of
> the recordset and loop through BCP until there are no more records.
> Looks something like

WHILE 1=1 BEGIN
SELECT TOP 1 @.OrderID=OrderID,@.MyText=myText,@.MyFileName=myFile Name
from tblOrders where isOutput = 0

IF @.@.ROWCOUNT = 0 BREAK
> SET @.ExportCommand = 'BCP '+@.myText+' queryout "c:\' + @.myFileName+ '" -T -c
> -S ' + @.@.SERVERNAME
> EXEC @.ReturnCode = master..xp_cmdshell @.ExportCommand
> UPDATE myOrders SET isOutput = 1 WHERE orderID= @.orderID
END -- end of loop|||[I'm answering to Jim's post, since Lauren's has not made it here yet. My
ISP reconfigured the news server and it took them two days to realize
that it was no longer working.]

Jim Geissman (jim_geissman@.countrywide.com) writes:
> I realize there is a cost to using cursors, but since you're going
> to launch the command shell for BCP on every record, the cost of the
> cursor is probably insignificant. But if you insist...

Why Laruen does not want to use a cursor I don't know, but since he
has to iterate anyway, cursor is the best solution for iteration anyway.

Say that you instead do:

> SELECT TOP 1 @.OrderID=OrderID,@.MyText=myText,@.MyFileName=myFile Name
> from tblOrders where isOutput = 0

If there is no index on isOutput (and one would not expect that),
and the table is huge, this can be very expensive. I have no benchmarks,
but I would suggest that for an iteration a cursor is the best way to
go, although it depends on the cursor type. FAST_FORWARD may be the
fastest, but I always use INSENSITIVE.

Anyway, Laruen should not do this in T-SQL at all, he should use VBscript
or similar as I suggested in my previous post. It will be easier to
program and execute faster.

Also, it occurred to me that if tblOrders.myText is the text that is
to be written to the file, the QueryOut thing will not work, since the
newlines in myText causes problem. Then again if the query for queryout is

'SELECT myText FROM tblOrders = ' + str(@.orderid)

that will work.

--
Erland Sommarskog, SQL Server MVP, esquel@.sommarskog.se

Books Online for SQL Server SP3 at
http://www.microsoft.com/sql/techin.../2000/books.asp|||Erland (and Jim)
You guys have gone above and beyond the call of duty in your response
to my problem and because of your repsonses I have been able to roll
this out. Thanks a million, and I have only one correction for
Erland's post - substitute "she" for "he" and it's 100% correct!
Thanks,
lq

Erland Sommarskog <esquel@.sommarskog.se> wrote in message news:<Xns9534EF744A28AYazorman@.127.0.0.1>...
> [I'm answering to Jim's post, since Lauren's has not made it here yet. My
> ISP reconfigured the news server and it took them two days to realize
> that it was no longer working.]
> Jim Geissman (jim_geissman@.countrywide.com) writes:
> > I realize there is a cost to using cursors, but since you're going
> > to launch the command shell for BCP on every record, the cost of the
> > cursor is probably insignificant. But if you insist...
> Why Laruen does not want to use a cursor I don't know, but since he
> has to iterate anyway, cursor is the best solution for iteration anyway.
> Say that you instead do:
> > SELECT TOP 1 @.OrderID=OrderID,@.MyText=myText,@.MyFileName=myFile Name
> > from tblOrders where isOutput = 0
> If there is no index on isOutput (and one would not expect that),
> and the table is huge, this can be very expensive. I have no benchmarks,
> but I would suggest that for an iteration a cursor is the best way to
> go, although it depends on the cursor type. FAST_FORWARD may be the
> fastest, but I always use INSENSITIVE.
> Anyway, Laruen should not do this in T-SQL at all, he should use VBscript
> or similar as I suggested in my previous post. It will be easier to
> program and execute faster.
> Also, it occurred to me that if tblOrders.myText is the text that is
> to be written to the file, the QueryOut thing will not work, since the
> newlines in myText causes problem. Then again if the query for queryout is
> 'SELECT myText FROM tblOrders = ' + str(@.orderid)
> that will work.|||Lauren Quantrell (laurenquantrell@.hotmail.com) writes:
> You guys have gone above and beyond the call of duty in your response
> to my problem and because of your repsonses I have been able to roll
> this out. Thanks a million, and I have only one correction for
> Erland's post - substitute "she" for "he" and it's 100% correct!

Glad to hear that you got it working! And my cheeks blossom in embarrassment
for calling you a man. I remember it to next time.

--
Erland Sommarskog, SQL Server MVP, esquel@.sommarskog.se

Books Online for SQL Server SP3 at
http://www.microsoft.com/sql/techin.../2000/books.aspsql

lookup and commit; How it works

Lookup and commit; How it works
I am importing data from text file and I have data lookup to check reference table.

If the reference row doesn't exist I want to add row to reference table, other wise row is added to the detail table.

I am using oledb destination to saving reference table row with rows per batch to 1 and maximum insert commit size to 1.

When I run the package duplicate rows are in grid view. How can duplicates end in there the commit size is 1? Next time the data exists in reference table and should be going to detail not to reference table.

Funny but this was just answered in another thread about the lookup cache. The dataflow works on buffers not rows so the lookup transform gets a whole buffer to process at one time. It then looks up every row in this buffer and after that passes it on downstream. So any row with the same key in that buffer will be looked up in the same manner and sent to the same output for processing. No setting on another transform can change this. Furthermore, depending on the cache type the lookup will load all its cache into memory (full and partial cache) so it will never (or not reliably) be updated by any changes to the underlying data.

HTH,

Matt

|||Well, I can guess that. How to fix this? add another transform? where? after lookup?|||

Well, you can't fix it. This is the design of the dataflow. You can try some workarounds such as setting the lookup to no cache mode or the dataflow's max rows to a low number (note that setting it to 1 doesn't work because the dataflow does rounding in order to not waste memory). However, none of these are certain to work in all cases. The only option is to write your own custom or script component that has logic to circumvent the buffering.

Matt

|||

HI, I have similar problem. Setting lookup to no cache or the dataflow to low number of max row did not work at all. I ended up building my own asynchronous sript component in order to achieve what the lookup or SCD wizard should be able to do.

Ccote

|||

We are currently investigating a ton of ideas around lookup, and this pattern is one we are taking into consideration.

However, I do want to point out that adding such a pattern requires us to add more logic to the lookup component and we are somewhat cautious about that. SSIS components are typically very tightly scoped in their functionality - design patterns are built with several different smaller components rather than in one more complex "catch all component." Lookup us an example of a component that does one fairly isolated function - complete integration patterns are built around it using other components.

The pattern we are dicussing here is actually more complicated than might first be thought - especially when one looks at the possibility of errors creeping in through system problems or bad data. (I have never in my career seen a data integration process where unexpected errors of all sorts did not creep in, so I tend to be cheerfully pessimistic in my designs.)

I'll recap the current requirement as follows, to make it clear for other readers:

We want to lookup the key from an incoming record in a reference table.|||

Great!!! It's really helpful. I have broken the process into two steps; first step add to reference table and next step lookup works(the way it should).

I can understand the import will be slow if every row is commited before look up, but there should be option, sometime it's should work logically and of course slow is not a word these days with powerful machines.

Thanks again Donald for your response .

Lookup - no matched records

Hi All,

I have two tables:TableA and TableB, both of the two tables have two fields: c_IDA char(10) and c_IDB char(10); A import text file includes the ID data, the data will insert into TableB only when the ID existed in TableA

The line in the import text file like this:

00000023450000012345

in the text file: 1-10 is the c_IDA and 11-20 is the c_IDB

In the Derived Column transformation,

set the column name IDA as expression: SUBSTRING(LINE,1,10)

set the column name IDB as expression: SUBSTRING(LINE,11,10)

In the followed Lookup transfornation, I created the reference table with a sql: Select c_IDA,c_IDB from TableA, the IDA and IDB in the pipeline linked to the reference table's c_IDA and c_IDB, i then setup the error output to another log file.

The problem is even though the ID existed in the TableA, the Lookup always generate the error out put, that means the ID not been found in the TableA at all.

In the sample above, if i run the sql in the SSMS:

Select * from TableA where c_IDA = '0000002345' and c_IDB = '0000012345'

there is one record retrived.

Any idea?

TIA

Are you casting the Derived Column to a DT_STR to match your char(10), or is it still set to DT_WSTR?

|||

I am using DT_STR

Thanks

|||

Have you used a data viewer immediately before the Lookup to validate that the values are what you expect?

Another potential issue is the collation settings on the database. Do you know what they are?

|||

Thanks again.

I put the data viewer before the Lookup and the data are displayed correctly. I am using the digit to present string, is it related with collation?

|||Collation affects sorting. It's one of the setting made when the SQL Server is set up, and under 2005, it can be configured for each database individually. It affects string comparisons, in some cases.

|||

But why I am able to retrive the correct records via Select in SSMS?

jwelch wrote:

Collation affects sorting. It's one of the setting made when the SQL Server is set up, and under 2005, it can be configured for each database individually. It affects string comparisons, in some cases.

|||

Because there the entire string is being interpeted by the database engine, versus in SSIS where some data is coming in from a flat file, and the other data is retrieved from the database engine.

That being said, I don't know for certain that this is your problem, but it is something to check.

|||

Whe i use Select SERVERPROPERTY(N'Collation'), it returns: Latin1_General_CI_AS

That means:

Case-insensitive, accent-sensitive, kana-insensitive, width-insensitive

is that?

jwelch wrote:

Because there the entire string is being interpeted by the database engine, versus in SSIS where some data is coming in from a flat file, and the other data is retrieved from the database engine.

That being said, I don't know for certain that this is your problem, but it is something to check.

|||

That one is unlikely to be causing this problem.

Looking for Info on Full Text Catalogs with a 'Recovering' Status

I have not been able to find any information on Full Text Catalogs (FTC) with
a status of 'Recovering'. If anyone can help me by responding to my
questions, I would greatly appreciate it.
1.How does a FTC get a status of 'Recovering'?
2.What implication does this status have on the FTC?
3.What is happening to the catalog while it is being recovered?
Pretty much I'm looking for any information I can find, so any
comments/links that would help me understand what is occurring are welcomed.
Thanks,
Like a database the full-text catalogs are transactional in nature. It can
be in the recovering state after an abrupt power off which will force a
consistency check when it is launched. Check the event log to see if there
are any messages from MSSCI or MSSearch which are relevant to this error.
Hilary Cotter
Director of Text Mining and Database Strategy
RelevantNOISE.Com - Dedicated to mining blogs for business intelligence.
This posting is my own and doesn't necessarily represent RelevantNoise's
positions, strategies or opinions.
Looking for a SQL Server replication book?
http://www.nwsu.com/0974973602.html
Looking for a FAQ on Indexing Services/SQL FTS
http://www.indexserverfaq.com
"robcam817" <robcam817@.discussions.microsoft.com> wrote in message
news:7F3703C9-E9E4-4AB0-9D84-F29A74DBED9E@.microsoft.com...
>I have not been able to find any information on Full Text Catalogs (FTC)
>with
> a status of 'Recovering'. If anyone can help me by responding to my
> questions, I would greatly appreciate it.
> 1. How does a FTC get a status of 'Recovering'?
> 2. What implication does this status have on the FTC?
> 3. What is happening to the catalog while it is being recovered?
> Pretty much I'm looking for any information I can find, so any
> comments/links that would help me understand what is occurring are
> welcomed.
> Thanks,
>

Looking for Info on Full Text Catalogs with a 'Recovering' Status

I have not been able to find any information on Full Text Catalogs (FTC) with
a status of 'Recovering'. If anyone can help me by responding to my
questions, I would greatly appreciate it.
1. How does a FTC get a status of 'Recovering'?
2. What implication does this status have on the FTC?
3. What is happening to the catalog while it is being recovered?
Pretty much I'm looking for any information I can find, so any
comments/links that would help me understand what is occurring are welcomed.
Thanks,Like a database the full-text catalogs are transactional in nature. It can
be in the recovering state after an abrupt power off which will force a
consistency check when it is launched. Check the event log to see if there
are any messages from MSSCI or MSSearch which are relevant to this error.
--
Hilary Cotter
Director of Text Mining and Database Strategy
RelevantNOISE.Com - Dedicated to mining blogs for business intelligence.
This posting is my own and doesn't necessarily represent RelevantNoise's
positions, strategies or opinions.
Looking for a SQL Server replication book?
http://www.nwsu.com/0974973602.html
Looking for a FAQ on Indexing Services/SQL FTS
http://www.indexserverfaq.com
"robcam817" <robcam817@.discussions.microsoft.com> wrote in message
news:7F3703C9-E9E4-4AB0-9D84-F29A74DBED9E@.microsoft.com...
>I have not been able to find any information on Full Text Catalogs (FTC)
>with
> a status of 'Recovering'. If anyone can help me by responding to my
> questions, I would greatly appreciate it.
> 1. How does a FTC get a status of 'Recovering'?
> 2. What implication does this status have on the FTC?
> 3. What is happening to the catalog while it is being recovered?
> Pretty much I'm looking for any information I can find, so any
> comments/links that would help me understand what is occurring are
> welcomed.
> Thanks,
>|||Hilary,
Thank you very much for responding to my post. I had an issue the other day
where the drive containing the FTData folder ran out of space which caused
the mssearch service to lock up. I stopped the service and freed up some
space on the drive and started the service again. When I restarted the
catalog went into a 'recovering' status. Here are some log entries from this
issue:
Event Type: Error
Event Source: Microsoft Search
Event Category: Indexer
Event ID: 7010
Date: 10/17/2006
Time: 3:08:20 PM
User: N/A
Computer: [server]
Description:
The project <SQLServer SQL0008700005> cannot be initialized. Error: 80041828
- The disk has reached its configured space limit.
For more information, see Help and Support Center at
http://go.microsoft.com/fwlink/events.asp.
Event Type: Error
Event Source: Microsoft Search
Event Category: Gatherer
Event ID: 3010
Date: 10/17/2006
Time: 12:52:31 AM
User: N/A
Computer: ANNRS100UT06
Description:
The transaction cannot be appended to the project <SQLServer SQL0008700006>
queue. File: e:\MSSQL\FTData\SQL0008700006\SQL0008700006.Ntfy1.gthr. Error:
80070070 - There is not enough space on the disk. .
For more information, see Help and Support Center at
http://go.microsoft.com/fwlink/events.asp.
Event Type: Failure Audit
Event Source: MssCi
Event Category: None
Event ID: 4133
Date: 10/17/2006
Time: 12:50:35 AM
User: N/A
Computer: [server]
Description:
Very low disk space was detected on drive
e:\mssql\ftdata\sql0008700005\build\indexer\cifiles. Please free up at least
24MB of space for content index to continue.
For more information, see Help and Support Center at
http://go.microsoft.com/fwlink/events.asp.
Here are some additional errors from the Application Log that I saw today
after I stopped and startded the MSSEARSH process for some testing: (i have
also included some gatherer logs entries below)
Event Type: Error
Event Source: Microsoft Search
Event Category: Gatherer
Event ID: 3013
Date: 10/17/2006
Time: 6:20:34 PM
User: N/A
Computer: [server]
Description:
The entry <MSSQL75://SQLSERVER/778AC167/006CFFA6> in the hash map on project
<SQLServer SQL0008700005> cannot be updated. Error: 8007054e - Unable to
complete the requested operation because of either a catastrophic media
failure or a data structure corruption on the disk. .
For more information, see Help and Support Center at
http://go.microsoft.com/fwlink/events.asp.
Event Type: Warning
Event Source: Microsoft Search
Event Category: Gatherer
Event ID: 3035
Date: 10/17/2006
Time: 6:20:34 PM
User: N/A
Computer: [server]
Description:
One or more warnings or errors for Gatherer project <SQLServer
SQL0008700006> were logged to file <C:\Program Files\Microsoft SQL
Server\MSSQL\FTData\SQLServer\GatherLogs\SQL0008700006.2.gthr>. If you are
interested in these messages, please, look at the file using the gatherer log
query object (gthrlog.vbs, log viewer web page).
For more information, see Help and Support Center at
http://go.microsoft.com/fwlink/events.asp.
Event Type: Error
Event Source: Application Error
Event Category: (100)
Event ID: 1000
Date: 10/17/2006
Time: 6:20:20 PM
User: N/A
Computer: ANNRS100UT06
Description:
Faulting application mssearch.exe, version 9.107.8320.9, faulting module
unknown, version 0.0.0.0, fault address 0x00000003.
For more information, see Help and Support Center at
http://go.microsoft.com/fwlink/events.asp.
Data:
0000: 41 70 70 6c 69 63 61 74 Applicat
0008: 69 6f 6e 20 46 61 69 6c ion Fail
0010: 75 72 65 20 20 6d 73 73 ure mss
0018: 65 61 72 63 68 2e 65 78 earch.ex
0020: 65 20 39 2e 31 30 37 2e e 9.107.
0028: 38 33 32 30 2e 39 20 69 8320.9 i
0030: 6e 20 75 6e 6b 6e 6f 77 n unknow
0038: 6e 20 30 2e 30 2e 30 2e n 0.0.0.
0040: 30 20 61 74 20 6f 66 66 0 at off
0048: 73 65 74 20 30 30 30 30 set 0000
0050: 30 30 30 33 0003
My main objective for the post was to find out what is happening to the
index when it is recovering. I have a general idea of what causes the
catalog to need to be recovered, but I wanted to know how ling it takes for
the recovery too. I am rebuilding some catalogs on a remote server and then
moving them back and I wanted to know if they will go thorugh the recovery
process an how long I can expect it to take or at least how I can estimate
how long it will take.
Additionally, here is the @.@.versino for the server:
Microsoft SQL Server 2000 - 8.00.2039 (Intel X86) May 3 2005 23:18:38
Copyright (c) 1988-2003 Microsoft Corporation Developer Edition on Windows
NT 5.2 (Build 3790: Service Pack 1)
Thank you for your help...
Dan
"Hilary Cotter" wrote:
> Like a database the full-text catalogs are transactional in nature. It can
> be in the recovering state after an abrupt power off which will force a
> consistency check when it is launched. Check the event log to see if there
> are any messages from MSSCI or MSSearch which are relevant to this error.
> --
> Hilary Cotter
> Director of Text Mining and Database Strategy
> RelevantNOISE.Com - Dedicated to mining blogs for business intelligence.
> This posting is my own and doesn't necessarily represent RelevantNoise's
> positions, strategies or opinions.
> Looking for a SQL Server replication book?
> http://www.nwsu.com/0974973602.html
> Looking for a FAQ on Indexing Services/SQL FTS
> http://www.indexserverfaq.com
>
> "robcam817" <robcam817@.discussions.microsoft.com> wrote in message
> news:7F3703C9-E9E4-4AB0-9D84-F29A74DBED9E@.microsoft.com...
> >I have not been able to find any information on Full Text Catalogs (FTC)
> >with
> > a status of 'Recovering'. If anyone can help me by responding to my
> > questions, I would greatly appreciate it.
> >
> > 1. How does a FTC get a status of 'Recovering'?
> > 2. What implication does this status have on the FTC?
> > 3. What is happening to the catalog while it is being recovered?
> >
> > Pretty much I'm looking for any information I can find, so any
> > comments/links that would help me understand what is occurring are
> > welcomed.
> >
> > Thanks,
> >
>
>|||Here is the Gatherer log info:
SQL0008700005.3.gthr:
Microsoft (R) Windows Script Host Version 5.6
Copyright (C) Microsoft Corporation 1996-2001. All rights reserved.
10/18/2006 11:18:16 AM Add The gatherer has started
10/18/2006 11:43:26 AM Add The recovery has completed
10/18/2006 3:16:10 PM Add The gatherer has started
10/18/2006 3:36:34 PM Add The recovery has completed
SQL0008700006.3.gthr:
Microsoft (R) Windows Script Host Version 5.6
Copyright (C) Microsoft Corporation 1996-2001. All rights reserved.
10/18/2006 11:18:16 AM Add The gatherer has started
10/18/2006 1:14:08 PM Add The recovery has completed
10/18/2006 3:16:10 PM Add The gatherer has started
SQL0008700006.2.gthr: (the end of another gatherer log)
10/17/2006 6:20:36 PM MSSQL75://SQLServer/47dbae45/0005EF0D Add Error
fetching URL, (80041812 - Content Index has been shutdown. )
10/17/2006 6:20:36 PM MSSQL75://SQLServer/151b244e/000DF6BD Add Error
fetching URL, (80041812 - Content Index has been shutdown. )
Thanks,
"robcam817" wrote:
> Hilary,
> Thank you very much for responding to my post. I had an issue the other day
> where the drive containing the FTData folder ran out of space which caused
> the mssearch service to lock up. I stopped the service and freed up some
> space on the drive and started the service again. When I restarted the
> catalog went into a 'recovering' status. Here are some log entries from this
> issue:
> Event Type: Error
> Event Source: Microsoft Search
> Event Category: Indexer
> Event ID: 7010
> Date: 10/17/2006
> Time: 3:08:20 PM
> User: N/A
> Computer: [server]
> Description:
> The project <SQLServer SQL0008700005> cannot be initialized. Error: 80041828
> - The disk has reached its configured space limit.
> For more information, see Help and Support Center at
> http://go.microsoft.com/fwlink/events.asp.
> Event Type: Error
> Event Source: Microsoft Search
> Event Category: Gatherer
> Event ID: 3010
> Date: 10/17/2006
> Time: 12:52:31 AM
> User: N/A
> Computer: ANNRS100UT06
> Description:
> The transaction cannot be appended to the project <SQLServer SQL0008700006>
> queue. File: e:\MSSQL\FTData\SQL0008700006\SQL0008700006.Ntfy1.gthr. Error:
> 80070070 - There is not enough space on the disk. .
> For more information, see Help and Support Center at
> http://go.microsoft.com/fwlink/events.asp.
>
> Event Type: Failure Audit
> Event Source: MssCi
> Event Category: None
> Event ID: 4133
> Date: 10/17/2006
> Time: 12:50:35 AM
> User: N/A
> Computer: [server]
> Description:
> Very low disk space was detected on drive
> e:\mssql\ftdata\sql0008700005\build\indexer\cifiles. Please free up at least
> 24MB of space for content index to continue.
> For more information, see Help and Support Center at
> http://go.microsoft.com/fwlink/events.asp.
>
> Here are some additional errors from the Application Log that I saw today
> after I stopped and startded the MSSEARSH process for some testing: (i have
> also included some gatherer logs entries below)
> Event Type: Error
> Event Source: Microsoft Search
> Event Category: Gatherer
> Event ID: 3013
> Date: 10/17/2006
> Time: 6:20:34 PM
> User: N/A
> Computer: [server]
> Description:
> The entry <MSSQL75://SQLSERVER/778AC167/006CFFA6> in the hash map on project
> <SQLServer SQL0008700005> cannot be updated. Error: 8007054e - Unable to
> complete the requested operation because of either a catastrophic media
> failure or a data structure corruption on the disk. .
> For more information, see Help and Support Center at
> http://go.microsoft.com/fwlink/events.asp.
>
> Event Type: Warning
> Event Source: Microsoft Search
> Event Category: Gatherer
> Event ID: 3035
> Date: 10/17/2006
> Time: 6:20:34 PM
> User: N/A
> Computer: [server]
> Description:
> One or more warnings or errors for Gatherer project <SQLServer
> SQL0008700006> were logged to file <C:\Program Files\Microsoft SQL
> Server\MSSQL\FTData\SQLServer\GatherLogs\SQL0008700006.2.gthr>. If you are
> interested in these messages, please, look at the file using the gatherer log
> query object (gthrlog.vbs, log viewer web page).
> For more information, see Help and Support Center at
> http://go.microsoft.com/fwlink/events.asp.
> Event Type: Error
> Event Source: Application Error
> Event Category: (100)
> Event ID: 1000
> Date: 10/17/2006
> Time: 6:20:20 PM
> User: N/A
> Computer: ANNRS100UT06
> Description:
> Faulting application mssearch.exe, version 9.107.8320.9, faulting module
> unknown, version 0.0.0.0, fault address 0x00000003.
> For more information, see Help and Support Center at
> http://go.microsoft.com/fwlink/events.asp.
> Data:
> 0000: 41 70 70 6c 69 63 61 74 Applicat
> 0008: 69 6f 6e 20 46 61 69 6c ion Fail
> 0010: 75 72 65 20 20 6d 73 73 ure mss
> 0018: 65 61 72 63 68 2e 65 78 earch.ex
> 0020: 65 20 39 2e 31 30 37 2e e 9.107.
> 0028: 38 33 32 30 2e 39 20 69 8320.9 i
> 0030: 6e 20 75 6e 6b 6e 6f 77 n unknow
> 0038: 6e 20 30 2e 30 2e 30 2e n 0.0.0.
> 0040: 30 20 61 74 20 6f 66 66 0 at off
> 0048: 73 65 74 20 30 30 30 30 set 0000
> 0050: 30 30 30 33 0003
> My main objective for the post was to find out what is happening to the
> index when it is recovering. I have a general idea of what causes the
> catalog to need to be recovered, but I wanted to know how ling it takes for
> the recovery too. I am rebuilding some catalogs on a remote server and then
> moving them back and I wanted to know if they will go thorugh the recovery
> process an how long I can expect it to take or at least how I can estimate
> how long it will take.
> Additionally, here is the @.@.versino for the server:
> Microsoft SQL Server 2000 - 8.00.2039 (Intel X86) May 3 2005 23:18:38
> Copyright (c) 1988-2003 Microsoft Corporation Developer Edition on Windows
> NT 5.2 (Build 3790: Service Pack 1)
> Thank you for your help...
> Dan
> "Hilary Cotter" wrote:
> > Like a database the full-text catalogs are transactional in nature. It can
> > be in the recovering state after an abrupt power off which will force a
> > consistency check when it is launched. Check the event log to see if there
> > are any messages from MSSCI or MSSearch which are relevant to this error.
> >
> > --
> > Hilary Cotter
> > Director of Text Mining and Database Strategy
> > RelevantNOISE.Com - Dedicated to mining blogs for business intelligence.
> >
> > This posting is my own and doesn't necessarily represent RelevantNoise's
> > positions, strategies or opinions.
> >
> > Looking for a SQL Server replication book?
> > http://www.nwsu.com/0974973602.html
> >
> > Looking for a FAQ on Indexing Services/SQL FTS
> > http://www.indexserverfaq.com
> >
> >
> >
> > "robcam817" <robcam817@.discussions.microsoft.com> wrote in message
> > news:7F3703C9-E9E4-4AB0-9D84-F29A74DBED9E@.microsoft.com...
> > >I have not been able to find any information on Full Text Catalogs (FTC)
> > >with
> > > a status of 'Recovering'. If anyone can help me by responding to my
> > > questions, I would greatly appreciate it.
> > >
> > > 1. How does a FTC get a status of 'Recovering'?
> > > 2. What implication does this status have on the FTC?
> > > 3. What is happening to the catalog while it is being recovered?
> > >
> > > Pretty much I'm looking for any information I can find, so any
> > > comments/links that would help me understand what is occurring are
> > > welcomed.
> > >
> > > Thanks,
> > >
> >
> >
> >|||Rob, you have disk space issues. free up disk space on your system
drive and the drives where your catalogs are stored.
robcam817 wrote:
> Here is the Gatherer log info:
> SQL0008700005.3.gthr:
> Microsoft (R) Windows Script Host Version 5.6
> Copyright (C) Microsoft Corporation 1996-2001. All rights reserved.
> 10/18/2006 11:18:16 AM Add The gatherer has started
> 10/18/2006 11:43:26 AM Add The recovery has completed
> 10/18/2006 3:16:10 PM Add The gatherer has started
> 10/18/2006 3:36:34 PM Add The recovery has completed
> SQL0008700006.3.gthr:
> Microsoft (R) Windows Script Host Version 5.6
> Copyright (C) Microsoft Corporation 1996-2001. All rights reserved.
> 10/18/2006 11:18:16 AM Add The gatherer has started
> 10/18/2006 1:14:08 PM Add The recovery has completed
> 10/18/2006 3:16:10 PM Add The gatherer has started
> SQL0008700006.2.gthr: (the end of another gatherer log)
> 10/17/2006 6:20:36 PM MSSQL75://SQLServer/47dbae45/0005EF0D Add Error
> fetching URL, (80041812 - Content Index has been shutdown. )
> 10/17/2006 6:20:36 PM MSSQL75://SQLServer/151b244e/000DF6BD Add Error
> fetching URL, (80041812 - Content Index has been shutdown. )
> Thanks,
> "robcam817" wrote:
> > Hilary,
> >
> > Thank you very much for responding to my post. I had an issue the other day
> > where the drive containing the FTData folder ran out of space which caused
> > the mssearch service to lock up. I stopped the service and freed up some
> > space on the drive and started the service again. When I restarted the
> > catalog went into a 'recovering' status. Here are some log entries from this
> > issue:
> >
> > Event Type: Error
> > Event Source: Microsoft Search
> > Event Category: Indexer
> > Event ID: 7010
> > Date: 10/17/2006
> > Time: 3:08:20 PM
> > User: N/A
> > Computer: [server]
> > Description:
> > The project <SQLServer SQL0008700005> cannot be initialized. Error: 80041828
> > - The disk has reached its configured space limit.
> >
> > For more information, see Help and Support Center at
> > http://go.microsoft.com/fwlink/events.asp.
> >
> > Event Type: Error
> > Event Source: Microsoft Search
> > Event Category: Gatherer
> > Event ID: 3010
> > Date: 10/17/2006
> > Time: 12:52:31 AM
> > User: N/A
> > Computer: ANNRS100UT06
> > Description:
> > The transaction cannot be appended to the project <SQLServer SQL0008700006>
> > queue. File: e:\MSSQL\FTData\SQL0008700006\SQL0008700006.Ntfy1.gthr. Error:
> > 80070070 - There is not enough space on the disk. .
> >
> > For more information, see Help and Support Center at
> > http://go.microsoft.com/fwlink/events.asp.
> >
> >
> > Event Type: Failure Audit
> > Event Source: MssCi
> > Event Category: None
> > Event ID: 4133
> > Date: 10/17/2006
> > Time: 12:50:35 AM
> > User: N/A
> > Computer: [server]
> > Description:
> > Very low disk space was detected on drive
> > e:\mssql\ftdata\sql0008700005\build\indexer\cifiles. Please free up at least
> > 24MB of space for content index to continue.
> >
> > For more information, see Help and Support Center at
> > http://go.microsoft.com/fwlink/events.asp.
> >
> >
> > Here are some additional errors from the Application Log that I saw today
> > after I stopped and startded the MSSEARSH process for some testing: (i have
> > also included some gatherer logs entries below)
> >
> > Event Type: Error
> > Event Source: Microsoft Search
> > Event Category: Gatherer
> > Event ID: 3013
> > Date: 10/17/2006
> > Time: 6:20:34 PM
> > User: N/A
> > Computer: [server]
> > Description:
> > The entry <MSSQL75://SQLSERVER/778AC167/006CFFA6> in the hash map on project
> > <SQLServer SQL0008700005> cannot be updated. Error: 8007054e - Unable to
> > complete the requested operation because of either a catastrophic media
> > failure or a data structure corruption on the disk. .
> >
> > For more information, see Help and Support Center at
> > http://go.microsoft.com/fwlink/events.asp.
> >
> >
> > Event Type: Warning
> > Event Source: Microsoft Search
> > Event Category: Gatherer
> > Event ID: 3035
> > Date: 10/17/2006
> > Time: 6:20:34 PM
> > User: N/A
> > Computer: [server]
> > Description:
> > One or more warnings or errors for Gatherer project <SQLServer
> > SQL0008700006> were logged to file <C:\Program Files\Microsoft SQL
> > Server\MSSQL\FTData\SQLServer\GatherLogs\SQL0008700006.2.gthr>. If you are
> > interested in these messages, please, look at the file using the gatherer log
> > query object (gthrlog.vbs, log viewer web page).
> >
> > For more information, see Help and Support Center at
> > http://go.microsoft.com/fwlink/events.asp.
> >
> > Event Type: Error
> > Event Source: Application Error
> > Event Category: (100)
> > Event ID: 1000
> > Date: 10/17/2006
> > Time: 6:20:20 PM
> > User: N/A
> > Computer: ANNRS100UT06
> > Description:
> > Faulting application mssearch.exe, version 9.107.8320.9, faulting module
> > unknown, version 0.0.0.0, fault address 0x00000003.
> >
> > For more information, see Help and Support Center at
> > http://go.microsoft.com/fwlink/events.asp.
> > Data:
> > 0000: 41 70 70 6c 69 63 61 74 Applicat
> > 0008: 69 6f 6e 20 46 61 69 6c ion Fail
> > 0010: 75 72 65 20 20 6d 73 73 ure mss
> > 0018: 65 61 72 63 68 2e 65 78 earch.ex
> > 0020: 65 20 39 2e 31 30 37 2e e 9.107.
> > 0028: 38 33 32 30 2e 39 20 69 8320.9 i
> > 0030: 6e 20 75 6e 6b 6e 6f 77 n unknow
> > 0038: 6e 20 30 2e 30 2e 30 2e n 0.0.0.
> > 0040: 30 20 61 74 20 6f 66 66 0 at off
> > 0048: 73 65 74 20 30 30 30 30 set 0000
> > 0050: 30 30 30 33 0003
> >
> > My main objective for the post was to find out what is happening to the
> > index when it is recovering. I have a general idea of what causes the
> > catalog to need to be recovered, but I wanted to know how ling it takes for
> > the recovery too. I am rebuilding some catalogs on a remote server and then
> > moving them back and I wanted to know if they will go thorugh the recovery
> > process an how long I can expect it to take or at least how I can estimate
> > how long it will take.
> >
> > Additionally, here is the @.@.versino for the server:
> > Microsoft SQL Server 2000 - 8.00.2039 (Intel X86) May 3 2005 23:18:38
> > Copyright (c) 1988-2003 Microsoft Corporation Developer Edition on Windows
> > NT 5.2 (Build 3790: Service Pack 1)
> >
> > Thank you for your help...
> > Dan
> >
> > "Hilary Cotter" wrote:
> >
> > > Like a database the full-text catalogs are transactional in nature. It can
> > > be in the recovering state after an abrupt power off which will force a
> > > consistency check when it is launched. Check the event log to see if there
> > > are any messages from MSSCI or MSSearch which are relevant to this error.
> > >
> > > --
> > > Hilary Cotter
> > > Director of Text Mining and Database Strategy
> > > RelevantNOISE.Com - Dedicated to mining blogs for business intelligence.
> > >
> > > This posting is my own and doesn't necessarily represent RelevantNoise's
> > > positions, strategies or opinions.
> > >
> > > Looking for a SQL Server replication book?
> > > http://www.nwsu.com/0974973602.html
> > >
> > > Looking for a FAQ on Indexing Services/SQL FTS
> > > http://www.indexserverfaq.com
> > >
> > >
> > >
> > > "robcam817" <robcam817@.discussions.microsoft.com> wrote in message
> > > news:7F3703C9-E9E4-4AB0-9D84-F29A74DBED9E@.microsoft.com...
> > > >I have not been able to find any information on Full Text Catalogs (FTC)
> > > >with
> > > > a status of 'Recovering'. If anyone can help me by responding to my
> > > > questions, I would greatly appreciate it.
> > > >
> > > > 1. How does a FTC get a status of 'Recovering'?
> > > > 2. What implication does this status have on the FTC?
> > > > 3. What is happening to the catalog while it is being recovered?
> > > >
> > > > Pretty much I'm looking for any information I can find, so any
> > > > comments/links that would help me understand what is occurring are
> > > > welcomed.
> > > >
> > > > Thanks,
> > > >
> > >
> > >
> > >|||Rob, you have disk space issues. free up disk space on your system
drive and the drives where your catalogs are stored.
robcam817 wrote:
> Here is the Gatherer log info:
> SQL0008700005.3.gthr:
> Microsoft (R) Windows Script Host Version 5.6
> Copyright (C) Microsoft Corporation 1996-2001. All rights reserved.
> 10/18/2006 11:18:16 AM Add The gatherer has started
> 10/18/2006 11:43:26 AM Add The recovery has completed
> 10/18/2006 3:16:10 PM Add The gatherer has started
> 10/18/2006 3:36:34 PM Add The recovery has completed
> SQL0008700006.3.gthr:
> Microsoft (R) Windows Script Host Version 5.6
> Copyright (C) Microsoft Corporation 1996-2001. All rights reserved.
> 10/18/2006 11:18:16 AM Add The gatherer has started
> 10/18/2006 1:14:08 PM Add The recovery has completed
> 10/18/2006 3:16:10 PM Add The gatherer has started
> SQL0008700006.2.gthr: (the end of another gatherer log)
> 10/17/2006 6:20:36 PM MSSQL75://SQLServer/47dbae45/0005EF0D Add Error
> fetching URL, (80041812 - Content Index has been shutdown. )
> 10/17/2006 6:20:36 PM MSSQL75://SQLServer/151b244e/000DF6BD Add Error
> fetching URL, (80041812 - Content Index has been shutdown. )
> Thanks,
> "robcam817" wrote:
> > Hilary,
> >
> > Thank you very much for responding to my post. I had an issue the other day
> > where the drive containing the FTData folder ran out of space which caused
> > the mssearch service to lock up. I stopped the service and freed up some
> > space on the drive and started the service again. When I restarted the
> > catalog went into a 'recovering' status. Here are some log entries from this
> > issue:
> >
> > Event Type: Error
> > Event Source: Microsoft Search
> > Event Category: Indexer
> > Event ID: 7010
> > Date: 10/17/2006
> > Time: 3:08:20 PM
> > User: N/A
> > Computer: [server]
> > Description:
> > The project <SQLServer SQL0008700005> cannot be initialized. Error: 80041828
> > - The disk has reached its configured space limit.
> >
> > For more information, see Help and Support Center at
> > http://go.microsoft.com/fwlink/events.asp.
> >
> > Event Type: Error
> > Event Source: Microsoft Search
> > Event Category: Gatherer
> > Event ID: 3010
> > Date: 10/17/2006
> > Time: 12:52:31 AM
> > User: N/A
> > Computer: ANNRS100UT06
> > Description:
> > The transaction cannot be appended to the project <SQLServer SQL0008700006>
> > queue. File: e:\MSSQL\FTData\SQL0008700006\SQL0008700006.Ntfy1.gthr. Error:
> > 80070070 - There is not enough space on the disk. .
> >
> > For more information, see Help and Support Center at
> > http://go.microsoft.com/fwlink/events.asp.
> >
> >
> > Event Type: Failure Audit
> > Event Source: MssCi
> > Event Category: None
> > Event ID: 4133
> > Date: 10/17/2006
> > Time: 12:50:35 AM
> > User: N/A
> > Computer: [server]
> > Description:
> > Very low disk space was detected on drive
> > e:\mssql\ftdata\sql0008700005\build\indexer\cifiles. Please free up at least
> > 24MB of space for content index to continue.
> >
> > For more information, see Help and Support Center at
> > http://go.microsoft.com/fwlink/events.asp.
> >
> >
> > Here are some additional errors from the Application Log that I saw today
> > after I stopped and startded the MSSEARSH process for some testing: (i have
> > also included some gatherer logs entries below)
> >
> > Event Type: Error
> > Event Source: Microsoft Search
> > Event Category: Gatherer
> > Event ID: 3013
> > Date: 10/17/2006
> > Time: 6:20:34 PM
> > User: N/A
> > Computer: [server]
> > Description:
> > The entry <MSSQL75://SQLSERVER/778AC167/006CFFA6> in the hash map on project
> > <SQLServer SQL0008700005> cannot be updated. Error: 8007054e - Unable to
> > complete the requested operation because of either a catastrophic media
> > failure or a data structure corruption on the disk. .
> >
> > For more information, see Help and Support Center at
> > http://go.microsoft.com/fwlink/events.asp.
> >
> >
> > Event Type: Warning
> > Event Source: Microsoft Search
> > Event Category: Gatherer
> > Event ID: 3035
> > Date: 10/17/2006
> > Time: 6:20:34 PM
> > User: N/A
> > Computer: [server]
> > Description:
> > One or more warnings or errors for Gatherer project <SQLServer
> > SQL0008700006> were logged to file <C:\Program Files\Microsoft SQL
> > Server\MSSQL\FTData\SQLServer\GatherLogs\SQL0008700006.2.gthr>. If you are
> > interested in these messages, please, look at the file using the gatherer log
> > query object (gthrlog.vbs, log viewer web page).
> >
> > For more information, see Help and Support Center at
> > http://go.microsoft.com/fwlink/events.asp.
> >
> > Event Type: Error
> > Event Source: Application Error
> > Event Category: (100)
> > Event ID: 1000
> > Date: 10/17/2006
> > Time: 6:20:20 PM
> > User: N/A
> > Computer: ANNRS100UT06
> > Description:
> > Faulting application mssearch.exe, version 9.107.8320.9, faulting module
> > unknown, version 0.0.0.0, fault address 0x00000003.
> >
> > For more information, see Help and Support Center at
> > http://go.microsoft.com/fwlink/events.asp.
> > Data:
> > 0000: 41 70 70 6c 69 63 61 74 Applicat
> > 0008: 69 6f 6e 20 46 61 69 6c ion Fail
> > 0010: 75 72 65 20 20 6d 73 73 ure mss
> > 0018: 65 61 72 63 68 2e 65 78 earch.ex
> > 0020: 65 20 39 2e 31 30 37 2e e 9.107.
> > 0028: 38 33 32 30 2e 39 20 69 8320.9 i
> > 0030: 6e 20 75 6e 6b 6e 6f 77 n unknow
> > 0038: 6e 20 30 2e 30 2e 30 2e n 0.0.0.
> > 0040: 30 20 61 74 20 6f 66 66 0 at off
> > 0048: 73 65 74 20 30 30 30 30 set 0000
> > 0050: 30 30 30 33 0003
> >
> > My main objective for the post was to find out what is happening to the
> > index when it is recovering. I have a general idea of what causes the
> > catalog to need to be recovered, but I wanted to know how ling it takes for
> > the recovery too. I am rebuilding some catalogs on a remote server and then
> > moving them back and I wanted to know if they will go thorugh the recovery
> > process an how long I can expect it to take or at least how I can estimate
> > how long it will take.
> >
> > Additionally, here is the @.@.versino for the server:
> > Microsoft SQL Server 2000 - 8.00.2039 (Intel X86) May 3 2005 23:18:38
> > Copyright (c) 1988-2003 Microsoft Corporation Developer Edition on Windows
> > NT 5.2 (Build 3790: Service Pack 1)
> >
> > Thank you for your help...
> > Dan
> >
> > "Hilary Cotter" wrote:
> >
> > > Like a database the full-text catalogs are transactional in nature. It can
> > > be in the recovering state after an abrupt power off which will force a
> > > consistency check when it is launched. Check the event log to see if there
> > > are any messages from MSSCI or MSSearch which are relevant to this error.
> > >
> > > --
> > > Hilary Cotter
> > > Director of Text Mining and Database Strategy
> > > RelevantNOISE.Com - Dedicated to mining blogs for business intelligence.
> > >
> > > This posting is my own and doesn't necessarily represent RelevantNoise's
> > > positions, strategies or opinions.
> > >
> > > Looking for a SQL Server replication book?
> > > http://www.nwsu.com/0974973602.html
> > >
> > > Looking for a FAQ on Indexing Services/SQL FTS
> > > http://www.indexserverfaq.com
> > >
> > >
> > >
> > > "robcam817" <robcam817@.discussions.microsoft.com> wrote in message
> > > news:7F3703C9-E9E4-4AB0-9D84-F29A74DBED9E@.microsoft.com...
> > > >I have not been able to find any information on Full Text Catalogs (FTC)
> > > >with
> > > > a status of 'Recovering'. If anyone can help me by responding to my
> > > > questions, I would greatly appreciate it.
> > > >
> > > > 1. How does a FTC get a status of 'Recovering'?
> > > > 2. What implication does this status have on the FTC?
> > > > 3. What is happening to the catalog while it is being recovered?
> > > >
> > > > Pretty much I'm looking for any information I can find, so any
> > > > comments/links that would help me understand what is occurring are
> > > > welcomed.
> > > >
> > > > Thanks,
> > > >
> > >
> > >
> > >

Looking for Info on Full Text Catalogs with a 'Recovering' Status

I have not been able to find any information on Full Text Catalogs (FTC) wit
h
a status of 'Recovering'. If anyone can help me by responding to my
questions, I would greatly appreciate it.
1. How does a FTC get a status of 'Recovering'?
2. What implication does this status have on the FTC?
3. What is happening to the catalog while it is being recovered?
Pretty much I'm looking for any information I can find, so any
comments/links that would help me understand what is occurring are welcomed.
Thanks,Like a database the full-text catalogs are transactional in nature. It can
be in the recovering state after an abrupt power off which will force a
consistency check when it is launched. Check the event log to see if there
are any messages from MSSCI or MSSearch which are relevant to this error.
Hilary Cotter
Director of Text Mining and Database Strategy
RelevantNOISE.Com - Dedicated to mining blogs for business intelligence.
This posting is my own and doesn't necessarily represent RelevantNoise's
positions, strategies or opinions.
Looking for a SQL Server replication book?
http://www.nwsu.com/0974973602.html
Looking for a FAQ on Indexing Services/SQL FTS
http://www.indexserverfaq.com
"robcam817" <robcam817@.discussions.microsoft.com> wrote in message
news:7F3703C9-E9E4-4AB0-9D84-F29A74DBED9E@.microsoft.com...
>I have not been able to find any information on Full Text Catalogs (FTC)
>with
> a status of 'Recovering'. If anyone can help me by responding to my
> questions, I would greatly appreciate it.
> 1. How does a FTC get a status of 'Recovering'?
> 2. What implication does this status have on the FTC?
> 3. What is happening to the catalog while it is being recovered?
> Pretty much I'm looking for any information I can find, so any
> comments/links that would help me understand what is occurring are
> welcomed.
> Thanks,
>

Looking for ideas...

I have a text file that I am importing in a data flow task. Not all of the rows are the same, there are "header" rows that contain a company code.

What I want to do is keep that company code and append that to the row of text that I am writing to a CSV file.

Since you cannot change variables until the post execute, what are my options?

Hope that's clear

Thanks!

BobP

Are you writing a custom script component to handle this? You talk of not being able to change variables until post execute, just handle the locking yourself and you can as illustrated here - http://forums.microsoft.com/MSDN/ShowPost.aspx?PostID=956181&SiteID=1|||From your description, I assume you're trying to denormalize a multi-formatted text file by moving data from header rows to detail rows.

Since your rows are not all the same, set your text file source component to read each line of the source file as a single column. Then write a custom script transformation component to consume that column, parse the data by row type, and output the individual columns that will be consumed by your destination (including the header columns). When the transformation encounters one of these header rows, put the parsed data (Company Code) into global variable(s) in the transformation component, and discard or redirect the header row. For each detail row, create a new output row and populate the "detail" columns from the parsed input data and the "header" column(s) (i.e. Company Code) from the the local variable(s). This way your header data is remembered for each subsequent detail row until another header is encountered.

Hope that helps.