[Dspam-user] The tokens is not going to database

classic Classic list List threaded Threaded
9 messages Options
Reply | Threaded
Open this post in threaded view
|

[Dspam-user] The tokens is not going to database

Alfredo Saldanha
Hello people,

According I've readed in DSpam documentation every token should be recorded in database with spam and ham hits.
It's not happening here, at least in my configuration.

DSpam version: http://dpaste.com/0RH4BPP
My dspam.conf: http://dpaste.com/3NHYP2D

For example, this is a new token that I'v got in DSpam log

1435067522 S "CLARO-FONE" <[hidden email]> 321,55896482221949723120456 FALE A VONTADE A PARTIR DE 19,90 POR MÊS. 0.026602 [hidden email] Delivered <[hidden email]>

It is not in database:

SELECT * FROM dspam_token_data WHERE token='55896482221949723120456';
Empty set (5.91 sec)

Some tip?

BR,

Alfredo Jr.

------------------------------------------------------------------------------
Monitor 25 network devices or servers for free with OpManager!
OpManager is web-based network management software that monitors
network devices and physical & virtual servers, alerts via email & sms
for fault. Monitor 25 devices for free with no restriction. Download now
http://ad.doubleclick.net/ddm/clk/292181274;119417398;o
_______________________________________________
Dspam-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/dspam-user
Reply | Threaded
Open this post in threaded view
|

Re: [Dspam-user] The tokens is not going to database

ktm@rice.edu
On Tue, Jun 23, 2015 at 11:36:11AM -0300, Alfredo Saldanha wrote:

> Hello people,
>
> According I've readed in DSpam documentation every token should be recorded in database with spam and ham hits.
> It's not happening here, at least in my configuration.
>
> DSpam version: http://dpaste.com/0RH4BPP
> My dspam.conf: http://dpaste.com/3NHYP2D
>
> For example, this is a new token that I'v got in DSpam log
>
> 1435067522 S "CLARO-FONE" <[hidden email]> 321,55896482221949723120456 FALE A VONTADE A PARTIR DE 19,90 POR MÊS. 0.026602 [hidden email] Delivered <[hidden email]>
>
> It is not in database:
>
> SELECT * FROM dspam_token_data WHERE token='55896482221949723120456';
> Empty set (5.91 sec)
>
> Some tip?
>
> BR,
>
> Alfredo Jr.
>

Hi Alredo,

That is the DSPAM signature and not a token. Check the signature table instead.

Regards,
Ken

------------------------------------------------------------------------------
Monitor 25 network devices or servers for free with OpManager!
OpManager is web-based network management software that monitors
network devices and physical & virtual servers, alerts via email & sms
for fault. Monitor 25 devices for free with no restriction. Download now
http://ad.doubleclick.net/ddm/clk/292181274;119417398;o
_______________________________________________
Dspam-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/dspam-user
Reply | Threaded
Open this post in threaded view
|

Re: [Dspam-user] The tokens is not going to database

Alfredo Saldanha
Hi ktm,

Thank you for your answer.
How can I get the token information from this signature?

BR.

----- Mensagem original -----
De: "ktm" <[hidden email]>
Para: [hidden email]
Enviadas: Terça-feira, 23 de junho de 2015 12:32:13
Assunto: Re: [Dspam-user] The tokens is not going to database

On Tue, Jun 23, 2015 at 11:36:11AM -0300, Alfredo Saldanha wrote:

> Hello people,
>
> According I've readed in DSpam documentation every token should be recorded in database with spam and ham hits.
> It's not happening here, at least in my configuration.
>
> DSpam version: http://dpaste.com/0RH4BPP 
> My dspam.conf: http://dpaste.com/3NHYP2D 
>
> For example, this is a new token that I'v got in DSpam log
>
> 1435067522 S "CLARO-FONE" <[hidden email]> 321,55896482221949723120456 FALE A VONTADE A PARTIR DE 19,90 POR MÊS. 0.026602 [hidden email] Delivered <[hidden email]>
>
> It is not in database:
>
> SELECT * FROM dspam_token_data WHERE token='55896482221949723120456';
> Empty set (5.91 sec)
>
> Some tip?
>
> BR,
>
> Alfredo Jr.
>

Hi Alredo,

That is the DSPAM signature and not a token. Check the signature table instead.

Regards,
Ken

------------------------------------------------------------------------------
Monitor 25 network devices or servers for free with OpManager!
OpManager is web-based network management software that monitors
network devices and physical & virtual servers, alerts via email & sms
for fault. Monitor 25 devices for free with no restriction. Download now
http://ad.doubleclick.net/ddm/clk/292181274;119417398;o 
_______________________________________________
Dspam-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/dspam-user 


------------------------------------------------------------------------------
Monitor 25 network devices or servers for free with OpManager!
OpManager is web-based network management software that monitors
network devices and physical & virtual servers, alerts via email & sms
for fault. Monitor 25 devices for free with no restriction. Download now
http://ad.doubleclick.net/ddm/clk/292181274;119417398;o
_______________________________________________
Dspam-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/dspam-user
Reply | Threaded
Open this post in threaded view
|

Re: [Dspam-user] The tokens is not going to database

ktm@rice.edu
On Tue, Jun 23, 2015 at 02:01:46PM -0300, Alfredo Saldanha wrote:
> Hi ktm,
>
> Thank you for your answer.
> How can I get the token information from this signature?
>
> BR.
>

In the MySQL schema, they are stored in the 'data' field in
the signature table. You can also look in the token table for tokens
with uid = 321, in this example. Check the 'last_hit' field for new
and recently used tokens.

Regards,
Ken

------------------------------------------------------------------------------
Monitor 25 network devices or servers for free with OpManager!
OpManager is web-based network management software that monitors
network devices and physical & virtual servers, alerts via email & sms
for fault. Monitor 25 devices for free with no restriction. Download now
http://ad.doubleclick.net/ddm/clk/292181274;119417398;o
_______________________________________________
Dspam-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/dspam-user
Reply | Threaded
Open this post in threaded view
|

Re: [Dspam-user] The tokens is not going to database

Alfredo Saldanha
I've been used dspam_crc to get token information.
I get the "from" by system.log in dspam directory as below:

1434635458 I "DOUGLAS TORRES " <[hidden email]> 321,5582ccc2180614948014227 Lida:_ORÇAMENTO_DE_SEGURO_AUTOMÓ Delivered <00e201d0a9cd$c6b00a80$54101f80$@domain.com.br>

# dspam_crc 'From*"DOUGLAS TORRES" <[hidden email]>'
TOKEN: 'From*"DOUGLAS TORRES" <[hidden email]>' CRC: 12104146969136729772

> SELECT * FROM dspam_token_data WHERE token='12104146969136729772';
+-----+----------------------+-----------+---------------+------------+
| uid | token                | spam_hits | innocent_hits | last_hit   |
+-----+----------------------+-----------+---------------+------------+
| 321 | 12104146969136729772 |         0 |          1458 | 2015-05-11 |
+-----+----------------------+-----------+---------------+------------+
1 row in set (5.97 sec)


But, I have a case that in system.log is different, there is only the name of sender (no email address) as you see below:

1435081484 S "Alessandra Range" 321,55899b0c95772809011008 Re: ORÇAMENTO DE SEGURO AUTOMÓVEL Delivered <[hidden email]>

# dspam_crc 'From*"Alessandra Range"'
TOKEN: 'From*"Alessandra Range"' CRC: 5333441504094406011

> SELECT * FROM dspam_token_data WHERE token='5333441504094406011';
Empty set (5.31 sec)

Where I made mistakes?

Thank you.

----- Mensagem original -----
De: "ktm" <[hidden email]>
Para: [hidden email]
Enviadas: Terça-feira, 23 de junho de 2015 15:11:59
Assunto: Re: [Dspam-user] The tokens is not going to database

On Tue, Jun 23, 2015 at 02:01:46PM -0300, Alfredo Saldanha wrote:
> Hi ktm,
>
> Thank you for your answer.
> How can I get the token information from this signature?
>
> BR.
>

In the MySQL schema, they are stored in the 'data' field in
the signature table. You can also look in the token table for tokens
with uid = 321, in this example. Check the 'last_hit' field for new
and recently used tokens.

Regards,
Ken

------------------------------------------------------------------------------
Monitor 25 network devices or servers for free with OpManager!
OpManager is web-based network management software that monitors
network devices and physical & virtual servers, alerts via email & sms
for fault. Monitor 25 devices for free with no restriction. Download now
http://ad.doubleclick.net/ddm/clk/292181274;119417398;o 
_______________________________________________
Dspam-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/dspam-user 

------------------------------------------------------------------------------
Monitor 25 network devices or servers for free with OpManager!
OpManager is web-based network management software that monitors
network devices and physical & virtual servers, alerts via email & sms
for fault. Monitor 25 devices for free with no restriction. Download now
http://ad.doubleclick.net/ddm/clk/292181274;119417398;o
_______________________________________________
Dspam-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/dspam-user
Reply | Threaded
Open this post in threaded view
|

Re: [Dspam-user] The tokens is not going to database

ktm@rice.edu
On Tue, Jun 23, 2015 at 03:38:26PM -0300, Alfredo Saldanha wrote:

> I've been used dspam_crc to get token information.
> I get the "from" by system.log in dspam directory as below:
>
> 1434635458 I "DOUGLAS TORRES " <[hidden email]> 321,5582ccc2180614948014227 Lida:_ORÇAMENTO_DE_SEGURO_AUTOMÓ Delivered <00e201d0a9cd$c6b00a80$54101f80$@domain.com.br>
>
> # dspam_crc 'From*"DOUGLAS TORRES" <[hidden email]>'
> TOKEN: 'From*"DOUGLAS TORRES" <[hidden email]>' CRC: 12104146969136729772
>
> > SELECT * FROM dspam_token_data WHERE token='12104146969136729772';
> +-----+----------------------+-----------+---------------+------------+
> | uid | token                | spam_hits | innocent_hits | last_hit   |
> +-----+----------------------+-----------+---------------+------------+
> | 321 | 12104146969136729772 |         0 |          1458 | 2015-05-11 |
> +-----+----------------------+-----------+---------------+------------+
> 1 row in set (5.97 sec)
>
>
> But, I have a case that in system.log is different, there is only the name of sender (no email address) as you see below:
>
> 1435081484 S "Alessandra Range" 321,55899b0c95772809011008 Re: ORÇAMENTO DE SEGURO AUTOMÓVEL Delivered <[hidden email]>
>
> # dspam_crc 'From*"Alessandra Range"'
> TOKEN: 'From*"Alessandra Range"' CRC: 5333441504094406011
>
> > SELECT * FROM dspam_token_data WHERE token='5333441504094406011';
> Empty set (5.31 sec)
>
> Where I made mistakes?
>
> Thank you.
>

Hi,

"Alessandra Range" is not a valid From: address. I have not checked the source code, but it
is completely possible that a correct address is needed to store a token. You have definitely
proven that that token is NOT stored.

Regards,
Ken

------------------------------------------------------------------------------
Monitor 25 network devices or servers for free with OpManager!
OpManager is web-based network management software that monitors
network devices and physical & virtual servers, alerts via email & sms
for fault. Monitor 25 devices for free with no restriction. Download now
http://ad.doubleclick.net/ddm/clk/292181274;119417398;o
_______________________________________________
Dspam-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/dspam-user
Reply | Threaded
Open this post in threaded view
|

Re: [Dspam-user] The tokens is not going to database

Alfredo Saldanha
Hello Ken,
Thank you again.
I made another test with another sender and I can see the token now.

But my real problem is another thing. I have a client that has a web form, it works fine, the message goes directly to inbox (he sent to me an example), when somebody reply the web form message, my dspam tagged this with spam, everything. I can not use whitelist (he has hundreds clients that receives this form) or increase the Innocent hits.

I suspect that my dspam is not training or doesn't consider the ham/spam hits in dspam_token_data table.
The number of update and insert is too low in mysql server.

----- Mensagem original -----
De: "ktm" <[hidden email]>
Para: [hidden email]
Enviadas: Terça-feira, 23 de junho de 2015 15:55:05
Assunto: Re: [Dspam-user] The tokens is not going to database

On Tue, Jun 23, 2015 at 03:38:26PM -0300, Alfredo Saldanha wrote:

> I've been used dspam_crc to get token information.
> I get the "from" by system.log in dspam directory as below:
>
> 1434635458 I "DOUGLAS TORRES " <[hidden email]> 321,5582ccc2180614948014227 Lida:_ORÇAMENTO_DE_SEGURO_AUTOMÓ Delivered <00e201d0a9cd$c6b00a80$54101f80$@domain.com.br>
>
> # dspam_crc 'From*"DOUGLAS TORRES" <[hidden email]>'
> TOKEN: 'From*"DOUGLAS TORRES" <[hidden email]>' CRC: 12104146969136729772
>
> > SELECT * FROM dspam_token_data WHERE token='12104146969136729772';
> +-----+----------------------+-----------+---------------+------------+
> | uid | token | spam_hits | innocent_hits | last_hit |
> +-----+----------------------+-----------+---------------+------------+
> | 321 | 12104146969136729772 | 0 | 1458 | 2015-05-11 |
> +-----+----------------------+-----------+---------------+------------+
> 1 row in set (5.97 sec)
>
>
> But, I have a case that in system.log is different, there is only the name of sender (no email address) as you see below:
>
> 1435081484 S "Alessandra Range" 321,55899b0c95772809011008 Re: ORÇAMENTO DE SEGURO AUTOMÓVEL Delivered <[hidden email]>
>
> # dspam_crc 'From*"Alessandra Range"'
> TOKEN: 'From*"Alessandra Range"' CRC: 5333441504094406011
>
> > SELECT * FROM dspam_token_data WHERE token='5333441504094406011';
> Empty set (5.31 sec)
>
> Where I made mistakes?
>
> Thank you.
>

Hi,

"Alessandra Range" is not a valid From: address. I have not checked the source code, but it
is completely possible that a correct address is needed to store a token. You have definitely
proven that that token is NOT stored.

Regards,
Ken

------------------------------------------------------------------------------
Monitor 25 network devices or servers for free with OpManager!
OpManager is web-based network management software that monitors
network devices and physical & virtual servers, alerts via email & sms
for fault. Monitor 25 devices for free with no restriction. Download now
http://ad.doubleclick.net/ddm/clk/292181274;119417398;o 
_______________________________________________
Dspam-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/dspam-user 

------------------------------------------------------------------------------
Monitor 25 network devices or servers for free with OpManager!
OpManager is web-based network management software that monitors
network devices and physical & virtual servers, alerts via email & sms
for fault. Monitor 25 devices for free with no restriction. Download now
http://ad.doubleclick.net/ddm/clk/292181274;119417398;o
_______________________________________________
Dspam-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/dspam-user
Reply | Threaded
Open this post in threaded view
|

Re: [Dspam-user] The tokens is not going to database

ktm@rice.edu
On Tue, Jun 23, 2015 at 06:43:00PM -0300, Alfredo Saldanha wrote:
> Hello Ken,
> Thank you again.
> I made another test with another sender and I can see the token now.
>
> But my real problem is another thing. I have a client that has a web form, it works fine, the message goes directly to inbox (he sent to me an example), when somebody reply the web form message, my dspam tagged this with spam, everything. I can not use whitelist (he has hundreds clients that receives this form) or increase the Innocent hits.
>
> I suspect that my dspam is not training or doesn't consider the ham/spam hits in dspam_token_data table.
> The number of update and insert is too low in mysql server.
>

Hi,

For the reply messages, the content will have to register as not spam. I would
recommend training using typical and reasonable replies to get the identification
level up. If someone replies using the form with a spam message, you want it to
be detected. Otherwise, by-pass dspam for the form return address.

Regards,
Ken

------------------------------------------------------------------------------
Monitor 25 network devices or servers for free with OpManager!
OpManager is web-based network management software that monitors
network devices and physical & virtual servers, alerts via email & sms
for fault. Monitor 25 devices for free with no restriction. Download now
http://ad.doubleclick.net/ddm/clk/292181274;119417398;o
_______________________________________________
Dspam-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/dspam-user
Reply | Threaded
Open this post in threaded view
|

Re: [Dspam-user] The tokens is not going to database

Alfredo Saldanha
Thank you Ken.

----- Mensagem original -----
De: "ktm" <[hidden email]>
Para: [hidden email]
Enviadas: Terça-feira, 23 de junho de 2015 19:20:08
Assunto: Re: [Dspam-user] The tokens is not going to database

On Tue, Jun 23, 2015 at 06:43:00PM -0300, Alfredo Saldanha wrote:
> Hello Ken,
> Thank you again.
> I made another test with another sender and I can see the token now.
>
> But my real problem is another thing. I have a client that has a web form, it works fine, the message goes directly to inbox (he sent to me an example), when somebody reply the web form message, my dspam tagged this with spam, everything. I can not use whitelist (he has hundreds clients that receives this form) or increase the Innocent hits.
>
> I suspect that my dspam is not training or doesn't consider the ham/spam hits in dspam_token_data table.
> The number of update and insert is too low in mysql server.
>

Hi,

For the reply messages, the content will have to register as not spam. I would
recommend training using typical and reasonable replies to get the identification
level up. If someone replies using the form with a spam message, you want it to
be detected. Otherwise, by-pass dspam for the form return address.

Regards,
Ken

------------------------------------------------------------------------------
Monitor 25 network devices or servers for free with OpManager!
OpManager is web-based network management software that monitors
network devices and physical & virtual servers, alerts via email & sms
for fault. Monitor 25 devices for free with no restriction. Download now
http://ad.doubleclick.net/ddm/clk/292181274;119417398;o 
_______________________________________________
Dspam-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/dspam-user 


------------------------------------------------------------------------------
Monitor 25 network devices or servers for free with OpManager!
OpManager is web-based network management software that monitors
network devices and physical & virtual servers, alerts via email & sms
for fault. Monitor 25 devices for free with no restriction. Download now
http://ad.doubleclick.net/ddm/clk/292181274;119417398;o
_______________________________________________
Dspam-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/dspam-user